Jun 24 00:08:31 devstack cinder-volume[82761]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 00:08:31 devstack cinder-volume[82761]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 00:08:31 devstack cinder-volume[82761]: we strongly recommend against using it for new projects. Jun 24 00:08:31 devstack cinder-volume[82761]: If you are already using Eventlet, we recommend migrating to a different Jun 24 00:08:31 devstack cinder-volume[82761]: framework. For more detail see Jun 24 00:08:31 devstack cinder-volume[82761]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 00:08:31 devstack cinder-volume[82761]: import eventlet # noqa Jun 24 00:08:33 devstack cinder-volume[82761]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 00:08:33 devstack cinder-volume[82761]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 00:08:33 devstack cinder-volume[82761]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 00:08:34 devstack cinder-volume[82761]: INFO dbcounter [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Registered counter for database cinder Jun 24 00:08:34 devstack cinder-volume[82761]: DEBUG oslo_db.sqlalchemy.engines [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82761) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:08:34 devstack cinder-volume[82761]: DEBUG dbcounter [-] [82761] Writer thread running {{(pid=82761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 00:08:34 devstack cinder-volume[82761]: INFO cinder.rpc [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 00:08:34 devstack cinder-volume[82761]: INFO cinder.rpc [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 00:08:34 devstack cinder-volume[82761]: DEBUG oslo_db.sqlalchemy.engines [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82761) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:08:34 devstack cinder-volume[82761]: INFO cinder.volume.manager [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Determined volume DB was empty at startup. Jun 24 00:08:34 devstack cinder-volume[82761]: DEBUG cinder.volume.manager [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82761) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 00:08:34 devstack cinder-volume[82761]: INFO cinder.volume.manager [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 24 00:08:34 devstack cinder-volume[82761]: WARNING stevedore.named [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 00:08:34 devstack cinder-volume[82761]: WARNING castellan.key_manager [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 00:08:34 devstack cinder-volume[82761]: WARNING cinder.keymgr.conf_key_mgr [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 00:08:34 devstack cinder-volume[82761]: DEBUG cinder.volume.drivers.lvm [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82761) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 24 00:08:34 devstack cinder-volume[82761]: DEBUG oslo_concurrency.processutils [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_concurrency.processutils [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] CMD "cinder-rtstool verify" returned: 0 in 0.371s {{(pid=82761) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_db.sqlalchemy.engines [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82761) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:08:35 devstack cinder-volume[82761]: INFO cinder.rpc [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 24 00:08:35 devstack cinder-volume[82761]: INFO cinder.rpc [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 24 00:08:35 devstack cinder-volume[82761]: WARNING stevedore.named [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 00:08:35 devstack cinder-volume[82761]: WARNING castellan.key_manager [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 00:08:35 devstack cinder-volume[82761]: INFO cinder.volume.manager [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_db.sqlalchemy.engines [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82761) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:08:35 devstack cinder-volume[82761]: INFO oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Starting 1 workers Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Started child 82939 {{(pid=82761) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Full set of CONF: {{(pid=82761) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] ******************************************************************************** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Configuration options gathered from: {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] ================================================================================ {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] allow_availability_zone_fallback = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] allow_compression_on_image_upload = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] allowed_direct_url_schemes = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] api_rate_limit = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] auth_strategy = keystone {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] az_cache_duration = 3600 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_availability_zone = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82939]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_host = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_stats_polling_interval = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backup_api_class = cinder.backup.api.API {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backup_name_template = backup-%s {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backup_use_same_host = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backup_use_temp_snapshot = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] chap_password = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] chap_username = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_internal_tenant_project_id = 091e3705ddb94ebebbc0794b9262e54c {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_internal_tenant_user_id = 383935475e9443ffbfa1ae1d71d0c6c7 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cloned_volume_same_az = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cluster = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] compression_format = gzip {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] compute_api_class = cinder.compute.nova.API {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] config_dir = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] config_source = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] control_exchange = openstack {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] debug = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] default_availability_zone = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] default_group_type = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] default_volume_type = lvmdriver-1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] disk_geometry = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] driver_client_cert = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] driver_client_cert_key = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] driver_data_namespace = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] driver_ssl_cert_path = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] driver_ssl_cert_verify = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] driver_use_ssl = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] enable_force_upload = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] enable_new_services = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] enable_unsupported_driver = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] enforce_multipath_for_image_xfer = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] filter_function = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_api_insecure = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_api_ssl_compression = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_ca_certificates_file = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_catalog_info = image:glance:publicURL {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_certfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_keyfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_num_retries = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance_request_timeout = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] goodness_function = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] graceful_shutdown_timeout = 5 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] group_api_class = cinder.group.api.API {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] host = devstack {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_compress_on_upload = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack sudo[82943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_conversion_address_space_limit = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_conversion_cpu_limit = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_conversion_disable = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_upload_use_cinder_backend = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_upload_use_internal_tenant = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_volume_cache_enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack sudo[82943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_volume_cache_max_count = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] image_volume_cache_max_size_gb = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] init_host_max_objects_retrieval = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] instance_format = [instance: %(uuid)s] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] iscsi_target_flags = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] iscsi_write_cache = on {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] iser_helper = tgtadm {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] iser_ip_address = 192.168.122.138 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] iser_port = 3260 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_color = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_config_append = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_dir = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_file = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_options = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_rotate_interval = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_rotate_interval_type = days {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] log_rotation_type = none {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] max_age = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] max_logfile_count = 30 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] max_logfile_size_mb = 200 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] max_over_subscription_ratio = 20.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] message_reap_interval = 86400 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] message_ttl = 2592000 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] migration_create_volume_timeout_secs = 300 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] monkey_patch = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] monkey_patch_modules = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] my_ip = 192.168.122.138 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] no_snapshot_gb_quota = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] num_iser_scan_tries = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] num_shell_tries = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] num_volume_device_scan_tries = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] nvmeof_conn_info_version = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] nvmet_ns_id = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] nvmet_port_id = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] osapi_max_limit = 1000 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] osapi_volume_ext_list = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] osapi_volume_listen_port = 8776 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] osapi_volume_use_ssl = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] osapi_volume_workers = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] per_volume_size_limit = -1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] periodic_fuzzy_delay = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] periodic_interval = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] public_endpoint = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] publish_errors = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] quota_backup_gigabytes = 1000 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] quota_backups = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] quota_gigabytes = 1000 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] quota_groups = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] quota_snapshots = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] quota_volumes = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] rate_limit_burst = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] rate_limit_except_level = CRITICAL {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] rate_limit_interval = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] reinit_driver_count = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] replication_device = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82939]: INFO cinder.volume.manager [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] report_discard_supported = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] report_interval = 120 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] reservation_clean_interval = 86400 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] reservation_expire = 86400 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] reserved_image_namespaces = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] reserved_percentage = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] rpc_response_timeout = 120 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] run_external_periodic_tasks = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] scst_target_driver = iscsi {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] scst_target_iqn_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_down_time = 720 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] shell_completion = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] snapshot_name_template = snapshot-%s {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] snapshot_same_host = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] split_loggers = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] state_path = /opt/stack/data/cinder {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] storage_availability_zone = nova {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] storage_protocol = iSCSI {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] syslog_log_facility = LOG_USER {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] target_helper = lioadm {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] target_ip_address = 192.168.122.138 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] target_port = 3260 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] target_protocol = iscsi {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] target_secondary_ip_addresses = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] trace_flags = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] transport_url = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] until_refresh = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] use_chap_auth = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] use_default_quota_class = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] use_journal = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] use_json = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] use_multipath_for_image_xfer = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] use_stderr = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] use_syslog = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] verify_glance_signatures = enabled {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_api_class = cinder.volume.api.API {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_backend_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_clear = zero {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_clear_ionice = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_clear_size = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_copy_bps_limit = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_dd_blocksize = 1M {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_name_template = volume-%s {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_service_inithost_offload = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volume_usage_audit_period = month {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] zoning_mode = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_concurrency.disable_process_locking = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.auth_section = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.auth_type = password {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.auth_version = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.cache = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.certfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.include_service_catalog = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.insecure = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.interface = public {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.keyfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_password = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcache_username = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.region_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.service_type = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.backend = dogpile.cache.null {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.backend_argument = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.backend_expiration_time = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.config_prefix = cache.oslo {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.debug_cache_backend = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.enable_retry_client = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.enable_socket_keepalive = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.expiration_time = 600 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.hashclient_retry_attempts = 2 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.memcache_dead_retry = 300 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.memcache_pool_maxsize = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.memcache_sasl_enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.057s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.password = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.proxies = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.redis_db = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.redis_server = localhost:6379 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.retry_attempts = 2 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.retry_delay = 0.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.socket_keepalive_count = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.socket_keepalive_idle = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.socket_keepalive_interval = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.socket_timeout = 1.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.tls_allowed_ciphers = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.tls_cafile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.tls_certfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.tls_enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.tls_keyfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cache.username = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] coordination.backend_url = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.asyncio_connection = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.asyncio_slave_connection = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.backend = sqlalchemy {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.connection = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.connection_debug = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.connection_parameters = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.connection_recycle_time = 3600 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.connection_trace = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.db_inc_retry_interval = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.db_max_retries = 20 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.db_max_retry_interval = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.db_retry_interval = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.max_overflow = 50 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.max_pool_size = 5 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.max_retries = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.mysql_wsrep_sync_wait = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.pool_timeout = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.retry_interval = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.slave_connection = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.sqlite_synchronous = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.synchronous_reader = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] database.use_db_reconnect = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.connection_string = messaging:// {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.es_doc_type = notification {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.es_scroll_size = 10000 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.es_scroll_time = 2m {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.filter_error_trace = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.hmac_keys = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.sentinel_service_name = mymaster {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.socket_timeout = 0.1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.trace_requests = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler.trace_sqlalchemy = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler_jaeger.process_tags = {} {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler_jaeger.service_name_prefix = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] profiler_otlp.service_name_prefix = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.enforce_new_defaults = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: WARNING oslo_config.cfg [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.enforce_scope = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.policy_default_rule = default {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.policy_file = policy.yaml {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] privsep_osbrick.group = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] privsep_osbrick.helper_command = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] privsep_osbrick.user = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_sys_admin.group = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_sys_admin.helper_command = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] cinder_sys_admin.user = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.auth_section = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.auth_type = password {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.cafile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.certfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.collect_timing = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.insecure = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.keyfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.send_service_user_token = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.split_loggers = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] service_user.timeout = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.auth_section = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.auth_type = password {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.certfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.collect_timing = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.insecure = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.keyfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.region_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.split_loggers = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] glance.timeout = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.backend_availability_zone = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.chap_password = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.chap_username = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.disk_geometry = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.driver_client_cert = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.driver_client_cert_key = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.driver_data_namespace = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.driver_use_ssl = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.extra_capabilities = {} {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.filter_function = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.goodness_function = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.iscsi_target_flags = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.iscsi_write_cache = on {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.iser_helper = tgtadm {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.iser_port = 3260 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.lvm_share_target = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.lvm_type = auto {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.num_shell_tries = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.replication_device = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.report_discard_supported = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.reserved_percentage = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.target_helper = tgtadm {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.target_port = 3260 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.target_protocol = iscsi {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.trace_flags = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.unique_fqdn_network = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.use_chap_auth = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_backend_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_clear = zero {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_clear_ionice = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_clear_size = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_reports.file_event_handler = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_reports.log_dir = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.backend_host = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.chap_password = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.chap_username = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.disk_geometry = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.driver_client_cert = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.extra_capabilities = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.filter_function = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.goodness_function = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.iser_helper = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.iser_ip_address = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.iser_port = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.lvm_share_target = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.lvm_type = auto {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.num_shell_tries = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.replication_device = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.report_discard_supported = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.reserved_percentage = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.scst_target_driver = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.storage_protocol = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.target_helper = lioadm {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.target_ip_address = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.target_port = 3260 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.trace_flags = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.use_chap_auth = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_clear = zero {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_clear_size = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] lvmdriver-1.volumes_dir = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.ssl = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_notifications.driver = [] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_notifications.retry = -1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] key_manager.fixed_key = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.barbican_api_version = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.barbican_endpoint = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.barbican_endpoint_type = public {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.barbican_region_name = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.cafile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.certfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.collect_timing = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.insecure = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.keyfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.number_of_retries = 60 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.retry_delay = 1 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.send_service_user_token = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.split_loggers = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.timeout = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.verify_ssl = True {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican.verify_ssl_path = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.auth_section = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.auth_type = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.cafile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.certfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.collect_timing = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.insecure = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.keyfile = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.split_loggers = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] barbican_service_user.timeout = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.approle_role_id = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.approle_secret_id = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.kv_mountpoint = secret {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.kv_path = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.kv_version = 2 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.namespace = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.root_token_id = **** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.ssl_ca_crt_file = None {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.timeout = 60.0 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.use_ssl = False {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:08:36 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] ******************************************************************************** {{(pid=82761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 00:08:36 devstack sudo[82943]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.862s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:36 devstack sudo[82948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:36 devstack sudo[82948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:37 devstack sudo[82948]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:37 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.625s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:37 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:08:37 devstack cinder-volume[82939]: INFO cinder.brick.local_dev.lvm [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 24 00:08:37 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:37 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:37 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:37 devstack sudo[83135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:08:37 devstack sudo[83135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:37 devstack sudo[83135]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:37 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:37 devstack cinder-volume[82939]: DEBUG cinder.brick.local_dev.lvm [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82939) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 24 00:08:37 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:37 devstack sudo[83366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:37 devstack sudo[83366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:39 devstack sudo[83366]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:39 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.559s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:39 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:39 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:39 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:39 devstack sudo[83703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:39 devstack sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:40 devstack sudo[83703]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:40 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.757s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:40 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:40 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:40 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:40 devstack sudo[83731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 24 00:08:40 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:40 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:40 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.691s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:40 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:40 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:08:40 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:41 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:41 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:41 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:41 devstack sudo[83741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:08:41 devstack sudo[83741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:42 devstack sudo[83741]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:42 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.837s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:42 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:42 devstack sudo[83750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:08:42 devstack sudo[83750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:43 devstack sudo[83750]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:43 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:43 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:43 devstack sudo[83756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:43 devstack sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:44 devstack sudo[83756]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:44 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.949s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:44 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:44 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:44 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:44 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:44 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:44 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:44 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.769s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:44 devstack cinder-volume[82939]: INFO cinder.volume.drivers.lvm [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 24 00:08:44 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:44 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:44 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:44 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:44 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:45 devstack cinder-volume[82761]: DEBUG dbcounter [-] [82761] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:08:45 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:45 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.766s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:45 devstack cinder-volume[82939]: DEBUG cinder.volume.drivers.lvm [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Updating volume stats {{(pid=82939) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 00:08:45 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:45 devstack sudo[83894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:08:45 devstack sudo[83894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:46 devstack sudo[83894]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:46 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:46 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:46 devstack sudo[84034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:08:46 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:46 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:46 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:46 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:46 devstack sudo[84038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:46 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:47 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:47 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:47 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:47 devstack sudo[84041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:08:47 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:48 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:48 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:48 devstack cinder-volume[82939]: INFO cinder.volume.driver [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 00:08:48 devstack cinder-volume[82939]: DEBUG cinder.volume.driver [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82939) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 00:08:48 devstack cinder-volume[82939]: DEBUG oslo_db.sqlalchemy.engines [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82939) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:08:48 devstack cinder-volume[82939]: DEBUG dbcounter [-] [82939] Writer thread running {{(pid=82939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 00:08:48 devstack cinder-volume[82939]: DEBUG cinder.db.api [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Building query based on filter {{(pid=82939) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3851}} Jun 24 00:08:48 devstack cinder-volume[82939]: DEBUG cinder.image.image_utils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82939) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 00:08:48 devstack cinder-volume[82939]: INFO cinder.keymgr.migration [None req-2aba7e15-8d89-4a9c-9a4e-011bf6ba6ffe None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 00:08:48 devstack cinder-volume[82939]: DEBUG cinder.volume.drivers.lvm [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Updating volume stats {{(pid=82939) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 00:08:48 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:48 devstack sudo[84045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:08:48 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:49 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:49 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:49 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:49 devstack sudo[84051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:08:49 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:49 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:49 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:49 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:49 devstack sudo[84056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:49 devstack sudo[84056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:50 devstack sudo[84056]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:50 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:50 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:50 devstack sudo[84060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:08:50 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:51 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:51 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:51 devstack cinder-volume[82939]: DEBUG cinder.manager [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Notifying Schedulers of capabilities ... {{(pid=82939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:08:51 devstack cinder-volume[82939]: INFO cinder.volume.manager [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Driver initialization completed successfully. Jun 24 00:08:51 devstack cinder-volume[82939]: INFO cinder.manager [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Initiating service 2 cleanup Jun 24 00:08:51 devstack cinder-volume[82939]: INFO cinder.manager [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Service 2 cleanup completed. Jun 24 00:08:51 devstack cinder-volume[82939]: DEBUG cinder.service [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Creating RPC server for service cinder-volume {{(pid=82939) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 00:08:51 devstack cinder-volume[82939]: DEBUG cinder.service [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82939) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 00:08:51 devstack cinder-volume[82939]: INFO cinder.volume.manager [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 24 00:08:51 devstack cinder-volume[82939]: DEBUG cinder.volume.drivers.lvm [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Updating volume stats {{(pid=82939) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 00:08:51 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:51 devstack sudo[84064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:08:51 devstack sudo[84064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:51 devstack sudo[84064]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:51 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.770s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:51 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:52 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:08:52 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:52 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:52 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:52 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:52 devstack sudo[84109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:08:52 devstack sudo[84109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:53 devstack sudo[84109]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:53 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:53 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:08:53 devstack sudo[84166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:08:53 devstack sudo[84166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:08:53 devstack sudo[84166]: pam_unix(sudo:session): session closed for user root Jun 24 00:08:53 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:08:53 devstack cinder-volume[82939]: INFO cinder.volume.manager [None req-fb94af3c-b86f-42e7-b8e1-8d9e64183a04 None None] Driver post RPC initialization completed successfully. Jun 24 00:09:01 devstack cinder-volume[82939]: DEBUG dbcounter [-] [82939] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:09:03 devstack cinder-volume[82939]: DEBUG dbcounter [-] [82939] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:09:14 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager._thread_info {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:09:14 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread count: 6 {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:09:14 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread info: [<_MainThread(MainThread, started 134964430610560)>, , , , , ] {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:10:14 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:10:14 devstack cinder-volume[82939]: DEBUG cinder.volume.drivers.lvm [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Updating volume stats {{(pid=82939) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 00:10:14 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:10:15 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:10:15 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:10:15 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Jun 24 00:10:15 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:10:15 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:10:15 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:10:15 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:10:16 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Jun 24 00:10:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:10:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:10:16 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:10:16 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:10:16 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Jun 24 00:10:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:10:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:10:16 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:10:16 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:10:17 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Jun 24 00:10:17 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:10:17 devstack cinder-volume[82939]: DEBUG cinder.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Notifying Schedulers of capabilities ... {{(pid=82939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:10:17 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager._thread_info {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:10:17 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread count: 6 {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:10:17 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread info: [<_MainThread(MainThread, started 134964430610560)>, , , , , ] {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:11:03 devstack cinder-volume[82939]: DEBUG dbcounter [-] [82939] Writing DB stats cinder:SELECT=1 {{(pid=82939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:11:03 devstack cinder-volume[82939]: DEBUG dbcounter [-] [82939] Writing DB stats cinder:UPDATE=1 {{(pid=82939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:11:14 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:11:14 devstack cinder-volume[82939]: DEBUG cinder.volume.drivers.lvm [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Updating volume stats {{(pid=82939) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 00:11:14 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:11:14 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:11:14 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:11:15 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Jun 24 00:11:15 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:11:15 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:11:15 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:11:15 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:11:16 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Jun 24 00:11:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:11:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:11:16 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:11:16 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:11:16 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Jun 24 00:11:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:11:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:11:16 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:11:16 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:11:17 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Jun 24 00:11:17 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:11:17 devstack cinder-volume[82939]: DEBUG cinder.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Notifying Schedulers of capabilities ... {{(pid=82939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:11:17 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager._thread_info {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:11:17 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread count: 6 {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:11:17 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread info: [<_MainThread(MainThread, started 134964430610560)>, , , , , ] {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:12:14 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:12:14 devstack cinder-volume[82939]: DEBUG cinder.volume.drivers.lvm [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Updating volume stats {{(pid=82939) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 00:12:14 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:12:14 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:12:14 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:12:15 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Jun 24 00:12:15 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:12:15 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:12:15 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:12:15 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:12:16 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Jun 24 00:12:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:12:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:12:16 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:12:16 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:12:16 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Jun 24 00:12:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:12:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:12:16 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:12:16 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:12:17 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jun 24 00:12:17 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:12:17 devstack cinder-volume[82939]: DEBUG cinder.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Notifying Schedulers of capabilities ... {{(pid=82939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:12:17 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager._thread_info {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:12:17 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread count: 6 {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:12:17 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread info: [<_MainThread(MainThread, started 134964430610560)>, , , , , ] {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:13:03 devstack cinder-volume[82939]: DEBUG dbcounter [-] [82939] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82939) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:13:14 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:13:14 devstack cinder-volume[82939]: DEBUG cinder.volume.drivers.lvm [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Updating volume stats {{(pid=82939) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 00:13:14 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:14 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 00:13:14 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:15 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:15 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:15 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:15 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:13:15 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:16 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:16 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 00:13:16 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:16 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:16 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:16 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 00:13:16 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:17 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:17 devstack cinder-volume[82939]: DEBUG oslo_concurrency.processutils [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=82939) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:17 devstack cinder-volume[82939]: DEBUG cinder.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Notifying Schedulers of capabilities ... {{(pid=82939) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:13:17 devstack cinder-volume[82939]: DEBUG oslo_service.periodic_task [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] Running periodic task VolumeManager._thread_info {{(pid=82939) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:13:17 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread count: 6 {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:13:17 devstack cinder-volume[82939]: DEBUG cinder.volume.manager [None req-3ae03273-8d79-4060-8e1d-7cb3eee90cef None None] thread info: [<_MainThread(MainThread, started 134964430610560)>, , , , , ] {{(pid=82939) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:13:35 devstack cinder-volume[82761]: INFO oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Caught SIGTERM, stopping children Jun 24 00:13:35 devstack cinder-volume[82761]: DEBUG oslo_concurrency.lockutils [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Acquiring lock "singleton_lock" {{(pid=82761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 00:13:35 devstack cinder-volume[82761]: DEBUG oslo_concurrency.lockutils [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Acquired lock "singleton_lock" {{(pid=82761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 00:13:35 devstack cinder-volume[82761]: DEBUG oslo_concurrency.lockutils [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Releasing lock "singleton_lock" {{(pid=82761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 00:13:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Stop services. {{(pid=82761) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 24 00:13:35 devstack cinder-volume[82761]: DEBUG oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Killing children. {{(pid=82761) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 24 00:13:35 devstack cinder-volume[82761]: INFO oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Waiting on 1 children to exit Jun 24 00:13:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.lockutils [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Acquiring lock "singleton_lock" {{(pid=82939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 00:13:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.lockutils [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Acquired lock "singleton_lock" {{(pid=82939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 00:13:36 devstack cinder-volume[82939]: DEBUG oslo_concurrency.lockutils [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Releasing lock "singleton_lock" {{(pid=82939) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 00:13:36 devstack cinder-volume[82939]: WARNING amqp [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 00:13:36 devstack cinder-volume[82939]: WARNING amqp [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 00:13:36 devstack cinder-volume[82761]: INFO oslo_service.backend._eventlet.service [None req-5dae2868-ffa5-4812-b6cf-d2efcb714711 None None] Child 82939 exited with status 0 Jun 24 00:13:36 devstack cinder-volume[93646]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 00:13:36 devstack cinder-volume[93646]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 00:13:36 devstack cinder-volume[93646]: we strongly recommend against using it for new projects. Jun 24 00:13:36 devstack cinder-volume[93646]: If you are already using Eventlet, we recommend migrating to a different Jun 24 00:13:36 devstack cinder-volume[93646]: framework. For more detail see Jun 24 00:13:36 devstack cinder-volume[93646]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 00:13:36 devstack cinder-volume[93646]: import eventlet # noqa Jun 24 00:13:38 devstack cinder-volume[93646]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 00:13:38 devstack cinder-volume[93646]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 00:13:38 devstack cinder-volume[93646]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 00:13:39 devstack cinder-volume[93646]: INFO dbcounter [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Registered counter for database cinder Jun 24 00:13:39 devstack cinder-volume[93646]: DEBUG oslo_db.sqlalchemy.engines [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:13:39 devstack cinder-volume[93646]: DEBUG dbcounter [-] [93646] Writer thread running {{(pid=93646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 00:13:39 devstack cinder-volume[93646]: INFO cinder.rpc [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 00:13:39 devstack cinder-volume[93646]: INFO cinder.rpc [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 00:13:39 devstack cinder-volume[93646]: DEBUG oslo_db.sqlalchemy.engines [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:13:39 devstack cinder-volume[93646]: INFO cinder.volume.manager [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Determined volume DB was empty at startup. Jun 24 00:13:39 devstack cinder-volume[93646]: DEBUG cinder.volume.manager [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93646) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 00:13:40 devstack cinder-volume[93646]: INFO cinder.volume.manager [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 24 00:13:40 devstack cinder-volume[93646]: WARNING stevedore.named [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 00:13:40 devstack cinder-volume[93646]: WARNING castellan.key_manager [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 00:13:40 devstack cinder-volume[93646]: WARNING cinder.keymgr.conf_key_mgr [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 00:13:40 devstack cinder-volume[93646]: INFO cinder.volume.manager [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_db.sqlalchemy.engines [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:13:40 devstack cinder-volume[93646]: INFO oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Starting 1 workers Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Started child 93867 {{(pid=93646) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Full set of CONF: {{(pid=93646) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] ******************************************************************************** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Configuration options gathered from: {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] ================================================================================ {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] allow_availability_zone_fallback = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] allow_compression_on_image_upload = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] allowed_direct_url_schemes = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] api_rate_limit = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] auth_strategy = keystone {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_availability_zone = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_host = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_stats_polling_interval = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backup_api_class = cinder.backup.api.API {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backup_name_template = backup-%s {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backup_use_same_host = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backup_use_temp_snapshot = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] chap_password = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] chap_username = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_internal_tenant_project_id = 091e3705ddb94ebebbc0794b9262e54c {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_internal_tenant_user_id = 383935475e9443ffbfa1ae1d71d0c6c7 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93867]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cluster = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] compression_format = gzip {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] compute_api_class = cinder.compute.nova.API {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] config_dir = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] config_source = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] control_exchange = openstack {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] debug = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] default_availability_zone = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] default_group_type = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] default_volume_type = QuobyteHD {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] disk_geometry = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] driver_client_cert = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] driver_client_cert_key = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] driver_data_namespace = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] driver_ssl_cert_path = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] driver_ssl_cert_verify = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] driver_use_ssl = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] enable_new_services = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] enable_unsupported_driver = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] enabled_backends = ['QuobyteHD'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] enforce_multipath_for_image_xfer = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] filter_function = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_api_insecure = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_api_ssl_compression = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_ca_certificates_file = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_catalog_info = image:glance:publicURL {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_certfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_keyfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_num_retries = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance_request_timeout = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] goodness_function = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] graceful_shutdown_timeout = 5 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] group_api_class = cinder.group.api.API {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] host = devstack {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_compress_on_upload = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_conversion_address_space_limit = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_conversion_cpu_limit = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_conversion_disable = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_upload_use_cinder_backend = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_upload_use_internal_tenant = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_volume_cache_enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_volume_cache_max_count = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] image_volume_cache_max_size_gb = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] init_host_max_objects_retrieval = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] instance_format = [instance: %(uuid)s] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] iscsi_target_flags = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] iscsi_write_cache = on {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] iser_helper = tgtadm {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] iser_ip_address = 192.168.122.138 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] iser_port = 3260 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_color = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_config_append = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_dir = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_file = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_options = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_rotate_interval = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_rotate_interval_type = days {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] log_rotation_type = none {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] max_age = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] max_logfile_count = 30 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] max_logfile_size_mb = 200 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] max_over_subscription_ratio = 20.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] message_reap_interval = 86400 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] message_ttl = 2592000 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] migration_create_volume_timeout_secs = 300 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] monkey_patch = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] monkey_patch_modules = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] my_ip = 192.168.122.138 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] no_snapshot_gb_quota = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] num_iser_scan_tries = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] num_shell_tries = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] num_volume_device_scan_tries = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] nvmeof_conn_info_version = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] nvmet_ns_id = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] nvmet_port_id = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] osapi_max_limit = 1000 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] osapi_volume_ext_list = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] osapi_volume_listen = 0.0.0.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] osapi_volume_listen_port = 8776 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] osapi_volume_use_ssl = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] osapi_volume_workers = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] per_volume_size_limit = -1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] periodic_fuzzy_delay = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] periodic_interval = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] project_id_regex = [0-9a-f\-]+ {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] public_endpoint = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] publish_errors = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] quota_backup_gigabytes = 1000 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] quota_backups = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] quota_gigabytes = 1000 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] quota_groups = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] quota_snapshots = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] quota_volumes = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] rate_limit_burst = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] rate_limit_except_level = CRITICAL {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] rate_limit_interval = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] reinit_driver_count = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] replication_device = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] report_discard_supported = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] report_interval = 120 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] reservation_clean_interval = 86400 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] reservation_expire = 86400 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] reserved_image_namespaces = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] reserved_percentage = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] rpc_response_timeout = 120 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] run_external_periodic_tasks = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] scst_target_driver = iscsi {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] scst_target_iqn_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_down_time = 720 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] shell_completion = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] snapshot_name_template = snapshot-%s {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] split_loggers = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] state_path = /opt/stack/data/cinder {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] storage_availability_zone = nova {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] storage_protocol = iSCSI {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] syslog_log_facility = LOG_USER {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] target_helper = lioadm {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] target_ip_address = 192.168.122.138 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] target_port = 3260 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] target_protocol = iscsi {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] target_secondary_ip_addresses = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] trace_flags = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] transfer_api_class = cinder.transfer.api.API {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] transport_url = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] until_refresh = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] use_chap_auth = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] use_default_quota_class = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] use_journal = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] use_json = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] use_multipath_for_image_xfer = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] use_stderr = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] use_syslog = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] verify_glance_signatures = enabled {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_api_class = cinder.volume.api.API {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_backend_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_clear = zero {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_clear_ionice = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_clear_size = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_copy_bps_limit = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_dd_blocksize = 1M {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_name_template = volume-%s {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_service_inithost_offload = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volume_usage_audit_period = month {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] zoning_mode = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_concurrency.disable_process_locking = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.auth_section = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.auth_type = password {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.auth_version = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.cache = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.certfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.delay_auth_decision = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.http_connect_timeout = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.include_service_catalog = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.insecure = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.interface = public {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.keyfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_password = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93867) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcache_username = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.region_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.service_token_roles_required = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.service_type = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.token_cache_time = 300 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.backend = dogpile.cache.null {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.backend_argument = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.backend_expiration_time = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.config_prefix = cache.oslo {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.debug_cache_backend = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.enable_retry_client = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.enable_socket_keepalive = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.expiration_time = 600 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.hashclient_retry_attempts = 2 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.memcache_dead_retry = 300 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.memcache_pool_maxsize = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.memcache_sasl_enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.password = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.proxies = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.redis_db = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.redis_sentinel_service_name = mymaster {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.redis_server = localhost:6379 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.retry_attempts = 2 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.retry_delay = 0.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.socket_keepalive_count = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.socket_keepalive_idle = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.socket_keepalive_interval = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.socket_timeout = 1.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.tls_allowed_ciphers = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.tls_cafile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.tls_certfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.tls_enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.tls_keyfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cache.username = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] coordination.backend_url = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.asyncio_connection = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.asyncio_slave_connection = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.backend = sqlalchemy {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.connection = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.connection_debug = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.connection_parameters = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.connection_recycle_time = 3600 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.connection_trace = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.db_inc_retry_interval = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.db_max_retries = 20 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.db_max_retry_interval = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.db_retry_interval = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.max_overflow = 50 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.max_pool_size = 5 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.max_retries = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.mysql_wsrep_sync_wait = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.pool_timeout = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.retry_interval = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.slave_connection = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.sqlite_synchronous = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.synchronous_reader = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] database.use_db_reconnect = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.connection_string = messaging:// {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.es_doc_type = notification {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.es_scroll_size = 10000 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.es_scroll_time = 2m {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.filter_error_trace = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.hmac_keys = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.sentinel_service_name = mymaster {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.socket_timeout = 0.1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.trace_requests = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler.trace_sqlalchemy = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler_jaeger.process_tags = {} {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler_jaeger.service_name_prefix = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] profiler_otlp.service_name_prefix = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.enforce_new_defaults = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: WARNING oslo_config.cfg [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.enforce_scope = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.policy_default_rule = default {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.policy_file = policy.yaml {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_policy.remote_timeout = 60.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] privsep_osbrick.group = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] privsep_osbrick.helper_command = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] privsep_osbrick.user = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_sys_admin.group = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_sys_admin.helper_command = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] cinder_sys_admin.user = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.auth_section = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.auth_type = password {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.cafile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.certfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.collect_timing = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.insecure = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.keyfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.send_service_user_token = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.split_loggers = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] service_user.timeout = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93867) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 24 00:13:40 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 24 00:13:40 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.auth_section = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.auth_type = password {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Running cmd (subprocess): mount.quobyte {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.certfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.collect_timing = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.insecure = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.keyfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.region_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.split_loggers = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] glance.timeout = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.backend_availability_zone = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.chap_password = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.chap_username = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.disk_geometry = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.driver_client_cert = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.driver_client_cert_key = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.driver_data_namespace = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.driver_use_ssl = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.enable_unsupported_driver = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.extra_capabilities = {} {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.filter_function = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.goodness_function = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.iscsi_target_flags = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.iscsi_write_cache = on {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.iser_helper = tgtadm {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.iser_port = 3260 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_host = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_login = admin {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_mount_options = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_password = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_private_key = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_share_path = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_ssh_port = 22 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.num_shell_tries = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.nvmet_port_id = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.quobyte_client_cfg = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.quobyte_volume_url = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.replication_device = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.report_discard_supported = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.reserved_percentage = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.scst_target_driver = iscsi {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.scst_target_iqn_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.storage_protocol = iSCSI {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.target_helper = tgtadm {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.target_port = 3260 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.target_protocol = iscsi {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.trace_flags = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.unique_fqdn_network = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.use_chap_auth = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volume_backend_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volume_clear = zero {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volume_clear_ionice = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volume_clear_size = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_reports.file_event_handler = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_reports.log_dir = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.backend_availability_zone = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.backend_host = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.chap_password = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.chap_username = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.chiscsi_conf = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.disk_geometry = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.driver_client_cert = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.driver_client_cert_key = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.driver_data_namespace = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.driver_use_ssl = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.extra_capabilities = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.filter_function = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.goodness_function = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.iscsi_target_flags = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.iscsi_write_cache = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.iser_helper = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.iser_ip_address = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.iser_port = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.iser_target_prefix = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_host = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:13:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:13:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_login = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93867]: INFO cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 ... Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_mount_options = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_password = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f -c /etc/quobyte/client-cinder.cfg {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_private_key = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_share_path = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_ssh_port = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.num_shell_tries = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nvmet_ns_id = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.nvmet_port_id = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.replication_device = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.report_discard_supported = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.reserved_percentage = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.scst_target_driver = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.storage_protocol = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.target_helper = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.target_ip_address = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.target_port = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.target_prefix = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.target_protocol = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.trace_flags = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.unique_fqdn_network = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.use_chap_auth = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f -c /etc/quobyte/client-cinder.cfg Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volume_clear = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volume_clear_ionice = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volume_clear_size = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] QuobyteHD.volumes_dir = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.ssl = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.ssl_version = {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_notifications.driver = [] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_notifications.retry = -1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] oslo_messaging_notifications.transport_url = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] key_manager.fixed_key = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.barbican_api_version = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.barbican_endpoint = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.barbican_endpoint_type = public {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.barbican_region_name = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.cafile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.certfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.collect_timing = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.insecure = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.keyfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.number_of_retries = 60 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.retry_delay = 1 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.send_service_user_token = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.split_loggers = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.timeout = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.verify_ssl = True {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican.verify_ssl_path = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.auth_section = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.auth_type = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.cafile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.certfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.collect_timing = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.insecure = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.keyfile = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.split_loggers = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] barbican_service_user.timeout = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.approle_role_id = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.approle_secret_id = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.kv_mountpoint = secret {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.kv_path = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.kv_version = 2 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.namespace = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.root_token_id = **** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.ssl_ca_crt_file = None {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.timeout = 60.0 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.use_ssl = False {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:40 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] ******************************************************************************** {{(pid=93646) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 00:13:41 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.789s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:41 devstack cinder-volume[93867]: INFO cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 succeeded Jun 24 00:13:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:13:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.802s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:13:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:41 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:13:41 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:42 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.771s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:42 devstack cinder-volume[93867]: INFO cinder.volume.driver [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG cinder.volume.driver [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578163146973, 'free_capacity_gb': 1775.7578163146973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93867) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG oslo_db.sqlalchemy.engines [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writer thread running {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG cinder.db.api [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Building query based on filter {{(pid=93867) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3851}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93867) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 00:13:42 devstack cinder-volume[93867]: INFO cinder.keymgr.migration [None req-81b98b8b-2598-42a6-b73f-8a44fa6156b2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:13:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:42 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:13:42 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:43 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.969s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:13:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Driver initialization completed successfully. Jun 24 00:13:43 devstack cinder-volume[93867]: INFO cinder.manager [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Initiating service 3 cleanup Jun 24 00:13:43 devstack cinder-volume[93867]: INFO cinder.manager [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Service 3 cleanup completed. Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG cinder.service [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Creating RPC server for service cinder-volume {{(pid=93867) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG cinder.service [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93867) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 00:13:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:43 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:13:43 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:43 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ede28f5a-e945-4642-b406-08dccdb7aa90 None None] Driver post RPC initialization completed successfully. Jun 24 00:13:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89198a76-8ac9-4041-8803-dfa975a45ca9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:13:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89198a76-8ac9-4041-8803-dfa975a45ca9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:13:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-89198a76-8ac9-4041-8803-dfa975a45ca9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:13:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-89198a76-8ac9-4041-8803-dfa975a45ca9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:13:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89198a76-8ac9-4041-8803-dfa975a45ca9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:13:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89198a76-8ac9-4041-8803-dfa975a45ca9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:46 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:13:46 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:46 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89198a76-8ac9-4041-8803-dfa975a45ca9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.648s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:46 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-89198a76-8ac9-4041-8803-dfa975a45ca9 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:13:49 devstack cinder-volume[93646]: INFO oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Caught SIGTERM, stopping children Jun 24 00:13:49 devstack cinder-volume[93646]: DEBUG oslo_concurrency.lockutils [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Acquiring lock "singleton_lock" {{(pid=93646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 00:13:49 devstack cinder-volume[93646]: DEBUG oslo_concurrency.lockutils [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Acquired lock "singleton_lock" {{(pid=93646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 00:13:49 devstack cinder-volume[93646]: DEBUG oslo_concurrency.lockutils [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Releasing lock "singleton_lock" {{(pid=93646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 00:13:49 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Stop services. {{(pid=93646) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 24 00:13:49 devstack cinder-volume[93646]: DEBUG oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Killing children. {{(pid=93646) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 24 00:13:49 devstack cinder-volume[93646]: INFO oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Waiting on 1 children to exit Jun 24 00:13:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Acquiring lock "singleton_lock" {{(pid=93867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 00:13:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Acquired lock "singleton_lock" {{(pid=93867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 00:13:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Releasing lock "singleton_lock" {{(pid=93867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 00:13:51 devstack cinder-volume[93867]: WARNING amqp [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 00:13:51 devstack cinder-volume[93867]: WARNING amqp [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 00:13:51 devstack cinder-volume[93646]: INFO oslo_service.backend._eventlet.service [None req-aafeb60a-6b9e-4795-b81b-9b8e1e88ca4f None None] Child 93867 exited with status 0 Jun 24 00:13:51 devstack cinder-volume[94150]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 00:13:51 devstack cinder-volume[94150]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 00:13:51 devstack cinder-volume[94150]: we strongly recommend against using it for new projects. Jun 24 00:13:51 devstack cinder-volume[94150]: If you are already using Eventlet, we recommend migrating to a different Jun 24 00:13:51 devstack cinder-volume[94150]: framework. For more detail see Jun 24 00:13:51 devstack cinder-volume[94150]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 00:13:51 devstack cinder-volume[94150]: import eventlet # noqa Jun 24 00:13:54 devstack cinder-volume[94150]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 00:13:54 devstack cinder-volume[94150]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 00:13:54 devstack cinder-volume[94150]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 00:13:55 devstack cinder-volume[94150]: INFO dbcounter [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Registered counter for database cinder Jun 24 00:13:56 devstack cinder-volume[94150]: DEBUG oslo_db.sqlalchemy.engines [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:13:56 devstack cinder-volume[94150]: DEBUG dbcounter [-] [94150] Writer thread running {{(pid=94150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 00:13:56 devstack cinder-volume[94150]: INFO cinder.rpc [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 00:13:56 devstack cinder-volume[94150]: INFO cinder.rpc [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 00:13:56 devstack cinder-volume[94150]: DEBUG oslo_db.sqlalchemy.engines [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:13:57 devstack cinder-volume[94150]: INFO cinder.volume.manager [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Determined volume DB was empty at startup. Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG cinder.volume.manager [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94150) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 00:13:57 devstack cinder-volume[94150]: WARNING stevedore.named [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 00:13:57 devstack cinder-volume[94150]: WARNING castellan.key_manager [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 00:13:57 devstack cinder-volume[94150]: WARNING cinder.keymgr.conf_key_mgr [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 00:13:57 devstack cinder-volume[94150]: INFO cinder.volume.manager [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_db.sqlalchemy.engines [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:13:57 devstack cinder-volume[94150]: INFO oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Starting 1 workers Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Started child 94472 {{(pid=94150) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Full set of CONF: {{(pid=94150) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] ******************************************************************************** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Configuration options gathered from: {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] ================================================================================ {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 00:13:57 devstack cinder-volume[94472]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] allow_availability_zone_fallback = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] allow_compression_on_image_upload = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] allowed_direct_url_schemes = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] api_rate_limit = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] auth_strategy = keystone {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_availability_zone = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_host = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_stats_polling_interval = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backup_api_class = cinder.backup.api.API {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backup_name_template = backup-%s {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backup_use_same_host = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backup_use_temp_snapshot = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] chap_password = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] chap_username = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_internal_tenant_project_id = 091e3705ddb94ebebbc0794b9262e54c {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_internal_tenant_user_id = 383935475e9443ffbfa1ae1d71d0c6c7 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cluster = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] compression_format = gzip {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] compute_api_class = cinder.compute.nova.API {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] config_dir = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] config_source = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] control_exchange = openstack {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] debug = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] default_availability_zone = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] default_group_type = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] default_volume_type = QuobyteHD {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] disk_geometry = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] driver_client_cert = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] driver_client_cert_key = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] driver_data_namespace = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] driver_ssl_cert_path = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] driver_ssl_cert_verify = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] driver_use_ssl = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] enable_new_services = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] enable_unsupported_driver = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] enabled_backends = ['QuobyteHD'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] enforce_multipath_for_image_xfer = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] filter_function = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_api_insecure = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_api_servers = ['http://192.168.122.138/image'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_api_ssl_compression = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_ca_certificates_file = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_catalog_info = image:glance:publicURL {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_certfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_keyfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_num_retries = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance_request_timeout = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] goodness_function = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] graceful_shutdown_timeout = 5 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] group_api_class = cinder.group.api.API {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] host = devstack {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_compress_on_upload = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_conversion_address_space_limit = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_conversion_cpu_limit = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_conversion_disable = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_upload_use_cinder_backend = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_upload_use_internal_tenant = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_volume_cache_enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_volume_cache_max_count = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] image_volume_cache_max_size_gb = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] init_host_max_objects_retrieval = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] instance_format = [instance: %(uuid)s] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] iscsi_target_flags = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] iscsi_write_cache = on {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] iser_helper = tgtadm {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] iser_ip_address = 192.168.122.138 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] iser_port = 3260 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_color = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_config_append = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_dir = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_file = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_options = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_rotate_interval = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_rotate_interval_type = days {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] log_rotation_type = none {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] max_age = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] max_logfile_count = 30 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] max_logfile_size_mb = 200 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94472) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] max_over_subscription_ratio = 20.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] message_reap_interval = 86400 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] message_ttl = 2592000 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] migration_create_volume_timeout_secs = 300 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] monkey_patch = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] monkey_patch_modules = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] my_ip = 192.168.122.138 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] no_snapshot_gb_quota = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] num_iser_scan_tries = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] num_shell_tries = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] num_volume_device_scan_tries = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] nvmeof_conn_info_version = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] nvmet_ns_id = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] nvmet_port_id = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] osapi_max_limit = 1000 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] osapi_volume_ext_list = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] osapi_volume_listen_port = 8776 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] osapi_volume_use_ssl = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] osapi_volume_workers = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] per_volume_size_limit = -1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] periodic_fuzzy_delay = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] periodic_interval = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] public_endpoint = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] publish_errors = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] quota_backup_gigabytes = 1000 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] quota_backups = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] quota_gigabytes = 1000 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] quota_groups = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] quota_snapshots = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] quota_volumes = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] rate_limit_burst = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] rate_limit_except_level = CRITICAL {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] rate_limit_interval = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] reinit_driver_count = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] replication_device = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] report_discard_supported = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] report_interval = 120 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] reservation_clean_interval = 86400 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] reservation_expire = 86400 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] reserved_image_namespaces = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] reserved_percentage = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] rpc_response_timeout = 120 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] run_external_periodic_tasks = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] scst_target_driver = iscsi {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] scst_target_iqn_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_down_time = 720 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] shell_completion = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] snapshot_name_template = snapshot-%s {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] split_loggers = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] state_path = /opt/stack/data/cinder {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] storage_availability_zone = nova {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] storage_protocol = iSCSI {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] syslog_log_facility = LOG_USER {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] target_helper = lioadm {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] target_ip_address = 192.168.122.138 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] target_port = 3260 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] target_protocol = iscsi {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] target_secondary_ip_addresses = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] trace_flags = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] transport_url = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] until_refresh = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] use_chap_auth = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] use_default_quota_class = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] use_journal = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] use_json = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] use_multipath_for_image_xfer = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] use_stderr = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] use_syslog = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] verify_glance_signatures = enabled {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_api_class = cinder.volume.api.API {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_backend_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_clear = zero {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_clear_ionice = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_clear_size = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_copy_bps_limit = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_dd_blocksize = 1M {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_name_template = volume-%s {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_service_inithost_offload = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volume_usage_audit_period = month {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] zoning_mode = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.auth_section = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.auth_type = password {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.auth_version = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.cache = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.certfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.include_service_catalog = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.insecure = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.interface = public {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.keyfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_password = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94472) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Running cmd (subprocess): mount.quobyte {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcache_username = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.region_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.service_type = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.138/identity {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.backend = dogpile.cache.null {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.backend_argument = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.backend_expiration_time = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.config_prefix = cache.oslo {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.debug_cache_backend = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.enable_retry_client = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.enable_socket_keepalive = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.expiration_time = 600 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.memcache_dead_retry = 300 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.memcache_pool_maxsize = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.memcache_sasl_enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.password = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.proxies = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.redis_db = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.redis_server = localhost:6379 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.retry_attempts = 2 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.retry_delay = 0.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.socket_keepalive_count = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.socket_keepalive_idle = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.socket_keepalive_interval = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.socket_timeout = 1.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.tls_allowed_ciphers = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.tls_cafile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.tls_certfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.tls_enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.tls_keyfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cache.username = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] coordination.backend_url = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.asyncio_connection = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.asyncio_slave_connection = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.backend = sqlalchemy {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.connection = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.connection_debug = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.connection_parameters = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.connection_recycle_time = 3600 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.connection_trace = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.db_inc_retry_interval = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.db_max_retries = 20 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.db_max_retry_interval = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.db_retry_interval = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.max_overflow = 50 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.max_pool_size = 5 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.max_retries = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.pool_timeout = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.retry_interval = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.slave_connection = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.sqlite_synchronous = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.synchronous_reader = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] database.use_db_reconnect = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.connection_string = messaging:// {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.es_doc_type = notification {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.es_scroll_size = 10000 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.es_scroll_time = 2m {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.filter_error_trace = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.hmac_keys = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.sentinel_service_name = mymaster {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.socket_timeout = 0.1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.trace_requests = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler.trace_sqlalchemy = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler_jaeger.process_tags = {} {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] profiler_otlp.service_name_prefix = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.enforce_new_defaults = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: WARNING oslo_config.cfg [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.enforce_scope = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.policy_default_rule = default {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.policy_file = policy.yaml {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] privsep_osbrick.group = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] privsep_osbrick.helper_command = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] privsep_osbrick.user = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_sys_admin.group = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_sys_admin.helper_command = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] cinder_sys_admin.user = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.auth_section = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.auth_type = password {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.cafile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.certfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.collect_timing = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.insecure = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.keyfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.send_service_user_token = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.split_loggers = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] service_user.timeout = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.auth_section = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.auth_type = password {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.certfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.collect_timing = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.insecure = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.keyfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.region_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.split_loggers = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] glance.timeout = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.backend_availability_zone = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack quobyte-client[94473]: Reading configuration file: /etc/quobyte/client.cfg Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.chap_password = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.chap_username = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.disk_geometry = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack quobyte-client[94473]: Invalid parameters found, error: missing mount point. Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.driver_client_cert = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.driver_client_cert_key = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack quobyte-client[94473]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:57 devstack quobyte-client[94473]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.driver_data_namespace = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.driver_use_ssl = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.extra_capabilities = {} {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.filter_function = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.goodness_function = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.iscsi_target_flags = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.iscsi_write_cache = on {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.iser_helper = tgtadm {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.iser_ip_address = 192.168.122.138 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.iser_port = 3260 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_host = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_login = admin {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_mount_options = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_password = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_private_key = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_share_path = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.num_shell_tries = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.quobyte_volume_url = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.replication_device = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.report_discard_supported = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.reserved_percentage = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.target_helper = tgtadm {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.target_ip_address = 192.168.122.138 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.target_port = 3260 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.target_protocol = iscsi {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.trace_flags = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.unique_fqdn_network = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.use_chap_auth = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volume_backend_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volume_clear = zero {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volume_clear_ionice = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volume_clear_size = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_reports.file_event_handler = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_reports.log_dir = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.backend_availability_zone = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.backend_host = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.chap_password = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.chap_username = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.chiscsi_conf = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.disk_geometry = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.driver_client_cert = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.driver_data_namespace = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.driver_use_ssl = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.extra_capabilities = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.filter_function = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.goodness_function = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.iser_helper = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.iser_ip_address = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.iser_port = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.iser_target_prefix = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_host = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_login = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_mount_options = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_password = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_private_key = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_share_path = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_ssh_port = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.num_shell_tries = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.nvmet_port_id = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.replication_device = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.report_discard_supported = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.reserved_percentage = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.scst_target_driver = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.storage_protocol = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.target_helper = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.target_ip_address = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.target_port = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.target_prefix = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.target_protocol = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.trace_flags = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.use_chap_auth = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volume_clear = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volume_clear_size = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] QuobyteHD.volumes_dir = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.ssl = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_notifications.driver = [] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] key_manager.fixed_key = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.barbican_api_version = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.barbican_endpoint = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.barbican_endpoint_type = public {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.barbican_region_name = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.cafile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.certfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.collect_timing = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.insecure = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.keyfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.number_of_retries = 60 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.retry_delay = 1 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.send_service_user_token = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.split_loggers = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.timeout = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.verify_ssl = True {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican.verify_ssl_path = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.auth_section = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.auth_type = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.cafile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.certfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.collect_timing = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.insecure = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.keyfile = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.split_loggers = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] barbican_service_user.timeout = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.approle_role_id = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.approle_secret_id = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.kv_mountpoint = secret {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.kv_path = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.kv_version = 2 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.namespace = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.root_token_id = **** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.ssl_ca_crt_file = None {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.timeout = 60.0 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.use_ssl = False {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 00:13:57 devstack cinder-volume[94150]: DEBUG oslo_service.backend._eventlet.service [None req-d8587638-c1b2-43f0-908a-7624978500d4 None None] ******************************************************************************** {{(pid=94150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 00:13:58 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.658s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:58 devstack cinder-volume[94472]: INFO cinder.volume.driver [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG cinder.volume.driver [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578163146973, 'free_capacity_gb': 1775.7578163146973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94472) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG oslo_db.sqlalchemy.engines [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94472) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writer thread running {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG cinder.db.api [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Building query based on filter {{(pid=94472) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3851}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94472) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:58 devstack cinder-volume[94472]: INFO cinder.keymgr.migration [None req-6d34c0bd-64d2-403e-b2b3-e1a5c0f23a6a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 00:13:58 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:13:58 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:58 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.626s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:13:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Driver initialization completed successfully. Jun 24 00:13:58 devstack cinder-volume[94472]: INFO cinder.manager [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Initiating service 3 cleanup Jun 24 00:13:58 devstack cinder-volume[94472]: INFO cinder.manager [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Service 3 cleanup completed. Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG cinder.service [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Creating RPC server for service cinder-volume {{(pid=94472) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 00:13:58 devstack cinder-volume[94472]: DEBUG cinder.service [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94472) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 00:13:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 24 00:13:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:13:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:13:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:13:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:13:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:13:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:13:59 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:13:59 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:13:59 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jun 24 00:13:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.606s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:13:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-354d592a-29e1-4565-ba51-51a84aec3880 None None] Driver post RPC initialization completed successfully. Jun 24 00:14:07 devstack cinder-volume[94150]: DEBUG dbcounter [-] [94150] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:14:08 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:14:09 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:14:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:14:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 6 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:14:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Flow 'volume_create_manager' (c697508d-318b-440e-8d20-c9715a12fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3e9162-cc67-429a-849a-16c0e64b38c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3e9162-cc67-429a-849a-16c0e64b38c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-132986558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547374b4-da1a-48e8-97f1-e0ed85fe6f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d1ee1b97744b6b67d7f77b688a379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:15:24Z,use_quota=True,user_id='0d76c376813548a8a618670d3a9eea79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3991cb-7554-4a84-9c08-9ba2b6411214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3991cb-7554-4a84-9c08-9ba2b6411214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c180f29-cc1f-4e82-afd8-89d5b9171c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c180f29-cc1f-4e82-afd8-89d5b9171c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547374b4-da1a-48e8-97f1-e0ed85fe6f0f', 'volume_name': 'volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9ec736-34f8-4c47-8a67-858683fefe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9ec736-34f8-4c47-8a67-858683fefe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7256c6-d08c-4e7e-a7ab-292f453a8cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Volume 547374b4-da1a-48e8-97f1-e0ed85fe6f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f', 'volume_size': 1} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-132986558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547374b4-da1a-48e8-97f1-e0ed85fe6f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d1ee1b97744b6b67d7f77b688a379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:15:24Z,use_quota=True,user_id='0d76c376813548a8a618670d3a9eea79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Creating volume 547374b4-da1a-48e8-97f1-e0ed85fe6f0f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:15:24 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:15:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:24 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f 1073741824 Jun 24 00:15:24 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:27 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f 1073741824" returned: 0 in 2.893s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:27 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f Jun 24 00:15:27 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Flow 'volume_create_manager' (898dd7ab-227a-4f35-b757-3573eae26f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1814efe-e47d-49a1-ac02-235187a9abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1814efe-e47d-49a1-ac02-235187a9abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1558258842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6367c0c845f43a6a91a626647b595fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:15:28Z,use_quota=True,user_id='24edd54ba8d24340b2a5bedb0a3b851e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7983aa-3d92-455f-8dcb-319b453c70b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7983aa-3d92-455f-8dcb-319b453c70b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bdf70f-98d1-4739-a26e-334ed55b9773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bdf70f-98d1-4739-a26e-334ed55b9773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce', 'volume_name': 'volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d2e8af-1dac-42c7-a6a4-253cabf2f89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d2e8af-1dac-42c7-a6a4-253cabf2f89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f426f9-b333-494c-8aac-9cc82b19c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Volume 66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce', 'volume_size': 1} Jun 24 00:15:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:29 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f" returned: 0 in 1.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] <== create_volume: return (4480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.482s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1558258842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6367c0c845f43a6a91a626647b595fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:15:28Z,use_quota=True,user_id='24edd54ba8d24340b2a5bedb0a3b851e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Creating volume 66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:15:29 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7256c6-d08c-4e7e-a7ab-292f453a8cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:29 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce 1073741824 Jun 24 00:15:29 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bece499-7fcb-4a98-aeed-11ecd50194c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Volume volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f (547374b4-da1a-48e8-97f1-e0ed85fe6f0f): created successfully Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bece499-7fcb-4a98-aeed-11ecd50194c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Flow 'volume_create_manager' (c697508d-318b-440e-8d20-c9715a12fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:15:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-47382412-3817-4090-8e68-77c07e78d7ba tempest-VolumesAdminNegativeTest-1503242010 None] Created volume successfully. Jun 24 00:15:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0d3becb6-4ec5-45cc-bd02-601542604366 tempest-GroupSnapshotsTest-1657221829 None] Group tempest-GroupSnapshotsTest-Group-45895905: creating Jun 24 00:15:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0d3becb6-4ec5-45cc-bd02-601542604366 tempest-GroupSnapshotsTest-1657221829 None] Group tempest-GroupSnapshotsTest-Group-45895905: created successfully Jun 24 00:15:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0d3becb6-4ec5-45cc-bd02-601542604366 tempest-GroupSnapshotsTest-1657221829 None] Create group completed successfully. Jun 24 00:15:31 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce 1073741824" returned: 0 in 2.021s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Acquiring lock "cinder-547374b4-da1a-48e8-97f1-e0ed85fe6f0f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:15:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Lock "cinder-547374b4-da1a-48e8-97f1-e0ed85fe6f0f-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:15:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:31 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce Jun 24 00:15:31 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Acquiring lock "cinder-quobyte-547374b4-da1a-48e8-97f1-e0ed85fe6f0f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:15:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Lock "cinder-quobyte-547374b4-da1a-48e8-97f1-e0ed85fe6f0f" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:15:31 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpya79vwll/privsep.sock'] Jun 24 00:15:31 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpya79vwll/privsep.sock Jun 24 00:15:31 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 00:15:33 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 24 00:15:33 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce" returned: 0 in 2.225s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] <== create_volume: return (4489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:15:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.495s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f426f9-b333-494c-8aac-9cc82b19c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3eda9b-4697-475c-b56e-68bd59e5f14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Volume volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce (66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce): created successfully Jun 24 00:15:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3eda9b-4697-475c-b56e-68bd59e5f14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Flow 'volume_create_manager' (898dd7ab-227a-4f35-b757-3573eae26f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:15:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-39314568-7f59-4775-b362-e32db48f5c92 tempest-DeleteServersTestJSON-1724122685 None] Created volume successfully. Jun 24 00:15:33 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Flow 'volume_create_manager' (2efbde05-d0fb-464e-925f-2efb4f612861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804810df-4b80-49bb-8b14-26081dad428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804810df-4b80-49bb-8b14-26081dad428a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525379694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97f0af7a-142c-45bb-be12-764de23c42b6,host='devstack@QuobyteHD#QuobyteHD',id=aecdb897-36e5-4441-a2e5-93ddc062e169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afad6dfc2e5644408d647909f614faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:15:34Z,use_quota=True,user_id='934200a5c7354dab9067820b552ffff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(293d5a6e-99cc-4117-9faf-6511e5774fb7),volume_type_id=293d5a6e-99cc-4117-9faf-6511e5774fb7)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51d70ca-2104-4f8a-b6ad-17f325f79ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51d70ca-2104-4f8a-b6ad-17f325f79ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84b4b5e-eae1-49b4-862b-178fbf914e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84b4b5e-eae1-49b4-862b-178fbf914e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aecdb897-36e5-4441-a2e5-93ddc062e169', 'volume_name': 'volume-aecdb897-36e5-4441-a2e5-93ddc062e169', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3addec2b-f3dc-48f9-86e3-2495da9f291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3addec2b-f3dc-48f9-86e3-2495da9f291e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428619f4-a1ed-44d2-9ca8-4bc77ad52f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Volume aecdb897-36e5-4441-a2e5-93ddc062e169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aecdb897-36e5-4441-a2e5-93ddc062e169', 'volume_size': 1} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97f0af7a-142c-45bb-be12-764de23c42b6,created_at=2026-06-23T22:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525379694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97f0af7a-142c-45bb-be12-764de23c42b6,host='devstack@QuobyteHD#QuobyteHD',id=aecdb897-36e5-4441-a2e5-93ddc062e169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afad6dfc2e5644408d647909f614faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:15:34Z,use_quota=True,user_id='934200a5c7354dab9067820b552ffff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(293d5a6e-99cc-4117-9faf-6511e5774fb7),volume_type_id=293d5a6e-99cc-4117-9faf-6511e5774fb7)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Creating volume aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:15:34 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:15:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:34 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 1073741824 Jun 24 00:15:34 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 00:15:34 devstack cinder-volume[94472]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 24 00:15:35 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:35 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Spawned new privsep daemon via rootwrap Jun 24 00:15:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Accepted privsep connection to /tmp/tmpya79vwll/privsep.sock {{(pid=94472) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 24 00:15:35 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 24 00:15:35 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 24 00:15:35 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 24 00:15:35 devstack cinder-volume[94472]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95823 Jun 24 00:15:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6630d5f-eb5a-4d64-afb1-f7cfa82210c7]: (2,) {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:15:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2778db0-1a09-4668-95de-a977171bf909]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:15:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:36 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f Jun 24 00:15:36 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:36 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 1073741824" returned: 0 in 2.286s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:36 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 Jun 24 00:15:36 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:37 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f" returned: 0 in 1.460s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:37 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f Jun 24 00:15:37 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:37 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169" returned: 0 in 1.289s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] <== create_volume: return (3649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.652s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428619f4-a1ed-44d2-9ca8-4bc77ad52f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aecdb897-36e5-4441-a2e5-93ddc062e169', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947cb4a4-4e2b-4036-92fe-5a071b461531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:37 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Volume volume-aecdb897-36e5-4441-a2e5-93ddc062e169 (aecdb897-36e5-4441-a2e5-93ddc062e169): created successfully Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947cb4a4-4e2b-4036-92fe-5a071b461531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Flow 'volume_create_manager' (2efbde05-d0fb-464e-925f-2efb4f612861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:15:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-60d71f21-1d84-4758-a8bb-e8abbfdffb2b tempest-GroupSnapshotsTest-1657221829 None] Created volume successfully. Jun 24 00:15:38 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-547374b4-da1a-48e8-97f1-e0ed85fe6f0f" returned: 0 in 1.310s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Lock "cinder-quobyte-547374b4-da1a-48e8-97f1-e0ed85fe6f0f" released by "delete_volume" :: held 7.200s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:15:38 devstack cinder-volume[94472]: WARNING cinder.quota [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:15:38 devstack cinder-volume[94472]: WARNING cinder.quota [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Created reservations ['dc7c9294-00fe-4dff-a5b0-c9eb87176c7a', 'f4ee8d30-c057-4469-a48e-35580d1566f9', '988b2f4d-3f67-4f88-9eb7-afce57784910', '1d14e79f-0e49-4fae-bbdc-14a2f7c7d4d7'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:39 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:15:39 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:39 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:15:39 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] GroupSnapshot 3c9f519b-215e-4ac0-a792-ee8361f4124d: creating. Jun 24 00:15:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Group snapshot 3c9f519b-215e-4ac0-a792-ee8361f4124d: creating. {{(pid=94472) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 00:15:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Creating offline snapshot a610974e-9887-485a-ac41-31945aba37bb of volume aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:15:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced5c070-3e17-4abe-8566-a71e9d20e26b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:15:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:41 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 Jun 24 00:15:41 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:43 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 3.655s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:43 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:15:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Deleted volume successfully. Jun 24 00:15:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1a11f883-b295-4f56-bcff-1abc43d44dbe tempest-VolumesAdminNegativeTest-1503242010 None] Lock "cinder-547374b4-da1a-48e8-97f1-e0ed85fe6f0f-delete_volume" released by "delete_volume" :: held 11.936s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:15:43 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 3.651s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:43 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:15:43 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:15:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 8 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:15:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:15:44 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169" returned: 0 in 3.526s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:44 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb 1G Jun 24 00:15:44 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:45 devstack cinder-volume[94472]: WARNING py.warnings [req-289ae81a-c01c-41bf-b038-dcce65da1829 req-ff91d4d6-dc09-4898-94f3-0d4ed8867f9b tempest-DeleteServersTestJSON-1724122685 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 24 00:15:45 devstack cinder-volume[94472]: .first() Jun 24 00:15:45 devstack cinder-volume[94472]: Jun 24 00:15:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-289ae81a-c01c-41bf-b038-dcce65da1829 req-ff91d4d6-dc09-4898-94f3-0d4ed8867f9b tempest-DeleteServersTestJSON-1724122685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:45 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb 1G" returned: 0 in 1.659s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecdb897-36e5-4441-a2e5-93ddc062e169 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:45 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecdb897-36e5-4441-a2e5-93ddc062e169 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb Jun 24 00:15:45 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:46 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecdb897-36e5-4441-a2e5-93ddc062e169 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb" returned: 0 in 0.958s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:46 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:15:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:46 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb Jun 24 00:15:46 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Flow 'volume_create_manager' (b6bb707e-ac58-4399-a8dd-68592eceb216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30e2585-7214-4a0b-b347-1a059a7652c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30e2585-7214-4a0b-b347-1a059a7652c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1567414367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af04f9f-9097-43c2-aae1-e80b240ff699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ec84e93f754eefaeac574a4143fca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:15:47Z,use_quota=True,user_id='d627dc0f8a4540478a0599ae08823a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aee908a-a810-4798-a60c-e8b2e644130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aee908a-a810-4798-a60c-e8b2e644130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f0579e-e719-46ff-ad88-2a88bd779261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f0579e-e719-46ff-ad88-2a88bd779261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af04f9f-9097-43c2-aae1-e80b240ff699', 'volume_name': 'volume-3af04f9f-9097-43c2-aae1-e80b240ff699', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77a3bf2-575e-4d5f-9ef4-23441dfcf4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77a3bf2-575e-4d5f-9ef4-23441dfcf4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8bc9b6-62f3-403f-b5aa-4b1951d0dfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:47 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Volume 3af04f9f-9097-43c2-aae1-e80b240ff699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af04f9f-9097-43c2-aae1-e80b240ff699', 'volume_size': 1} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:47 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb" returned: 0 in 0.687s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:47 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.info Jun 24 00:15:47 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:48 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.info" returned: 0 in 0.766s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:48 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:15:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:48 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.info Jun 24 00:15:48 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:49 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.info" returned: 0 in 0.777s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.631s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-289ae81a-c01c-41bf-b038-dcce65da1829 req-ff91d4d6-dc09-4898-94f3-0d4ed8867f9b tempest-DeleteServersTestJSON-1724122685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.291s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a64eb93-53a1-4b18-85a4-dd4c11f10181]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:15:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-289ae81a-c01c-41bf-b038-dcce65da1829 req-ff91d4d6-dc09-4898-94f3-0d4ed8867f9b tempest-DeleteServersTestJSON-1724122685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a3edf8e0-7267-41b6-bf02-8f8de5b441a2 tempest-GroupSnapshotsTest-1657221829 None] group_snapshot 3c9f519b-215e-4ac0-a792-ee8361f4124d: created successfully Jun 24 00:15:49 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce Jun 24 00:15:49 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:50 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-289ae81a-c01c-41bf-b038-dcce65da1829 req-ff91d4d6-dc09-4898-94f3-0d4ed8867f9b tempest-DeleteServersTestJSON-1724122685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce" returned: 0 in 1.081s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-289ae81a-c01c-41bf-b038-dcce65da1829 req-ff91d4d6-dc09-4898-94f3-0d4ed8867f9b tempest-DeleteServersTestJSON-1724122685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1567414367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af04f9f-9097-43c2-aae1-e80b240ff699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ec84e93f754eefaeac574a4143fca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:15:47Z,use_quota=True,user_id='d627dc0f8a4540478a0599ae08823a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Creating volume 3af04f9f-9097-43c2-aae1-e80b240ff699 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:15:50 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:50 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 1073741824 Jun 24 00:15:50 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-289ae81a-c01c-41bf-b038-dcce65da1829 req-ff91d4d6-dc09-4898-94f3-0d4ed8867f9b tempest-DeleteServersTestJSON-1724122685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ae0b417-4703-4184-be40-65746ffe3f9e', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:15:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-289ae81a-c01c-41bf-b038-dcce65da1829 req-ff91d4d6-dc09-4898-94f3-0d4ed8867f9b tempest-DeleteServersTestJSON-1724122685 None] attachment_update completed successfully. Jun 24 00:15:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:51 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 1073741824" returned: 0 in 1.181s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:51 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 Jun 24 00:15:51 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:52 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699" returned: 0 in 0.997s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.197s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-a610974e-9887-485a-ac41-31945aba37bb-a23a7139-c195-4f67-b78e-7e09bf78e7d8" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8bc9b6-62f3-403f-b5aa-4b1951d0dfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af04f9f-9097-43c2-aae1-e80b240ff699', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f3ae8f-e63d-44e8-98bf-b586f1ef9b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-a610974e-9887-485a-ac41-31945aba37bb-a23a7139-c195-4f67-b78e-7e09bf78e7d8" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Creating volume a23a7139-c195-4f67-b78e-7e09bf78e7d8 from snapshot a610974e-9887-485a-ac41-31945aba37bb {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-a23a7139-c195-4f67-b78e-7e09bf78e7d8" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:15:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Volume volume-3af04f9f-9097-43c2-aae1-e80b240ff699 (3af04f9f-9097-43c2-aae1-e80b240ff699): created successfully Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f3ae8f-e63d-44e8-98bf-b586f1ef9b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Flow 'volume_create_manager' (b6bb707e-ac58-4399-a8dd-68592eceb216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-a23a7139-c195-4f67-b78e-7e09bf78e7d8" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] snapshot: a610974e-9887-485a-ac41-31945aba37bb, volume: a23a7139-c195-4f67-b78e-7e09bf78e7d8, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:15:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-24084585-844d-4723-ad96-d395086d5f66 tempest-ServerRescueNegativeTestJSON-180808569 None] Created volume successfully. Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff5474e-2b0b-4747-abe3-fab8e4f09be8]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:15:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:52 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb Jun 24 00:15:52 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:54 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb" returned: 0 in 1.333s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aecdb897-36e5-4441-a2e5-93ddc062e169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:15:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:15:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:15:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef84b0b-7a6a-4f5a-9461-0396bd9ff6e0]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:15:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:54 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 Jun 24 00:15:54 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:15:55 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jun 24 00:15:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169" returned: 0 in 1.728s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:15:55 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:15:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:15:55 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 Jun 24 00:15:55 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-ce18466e-9f88-47da-bee2-1fc1f2de34d0 req-1be55f2e-50df-4283-950a-9b19e62dbbf9 tempest-DeleteServersTestJSON-1724122685 None] Terminate volume connection completed successfully. Jun 24 00:16:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-ce18466e-9f88-47da-bee2-1fc1f2de34d0 req-1be55f2e-50df-4283-950a-9b19e62dbbf9 tempest-DeleteServersTestJSON-1724122685 None] Deleting attachment 6ae0b417-4703-4184-be40-65746ffe3f9e. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:16:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8" returned: 0 in 8.629s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd9a291-f97a-4c14-ab59-c0ca69cc94a4]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:04 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 Jun 24 00:16:04 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:05 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169" returned: 0 in 1.205s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:05 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:16:05 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Converted 1024.00 MB image at 118.65 MB/s Jun 24 00:16:05 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:16:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:05 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 Jun 24 00:16:05 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:07 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8" returned: 0 in 1.431s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-a23a7139-c195-4f67-b78e-7e09bf78e7d8" released by "_copy_volume_from_snapshot" :: held 14.521s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-a610974e-9887-485a-ac41-31945aba37bb-a23a7139-c195-4f67-b78e-7e09bf78e7d8" released by "_create_volume_from_snapshot" :: held 14.587s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.630s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c1651df7-73ee-4e9c-b5f0-dc9686fe6f27 tempest-GroupSnapshotsTest-1657221829 None] Create group from source-snapshot-3c9f519b-215e-4ac0-a792-ee8361f4124d completed successfully. Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Acquiring lock "cinder-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Lock "cinder-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Acquiring lock "cinder-quobyte-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Lock "cinder-quobyte-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[736349ef-2c5f-408e-b12e-d312cdcbe7a8]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:07 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce Jun 24 00:16:07 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:09 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce" returned: 0 in 1.390s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:09 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce Jun 24 00:16:09 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-a23a7139-c195-4f67-b78e-7e09bf78e7d8" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-a23a7139-c195-4f67-b78e-7e09bf78e7d8" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7426c5fd-848e-4794-8a40-0f3788eeac58]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:09 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 Jun 24 00:16:09 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:10 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce" returned: 0 in 1.160s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Lock "cinder-quobyte-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce" released by "delete_volume" :: held 2.642s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Created reservations ['23649e9c-adc4-4d21-96bb-8d53bb3c0d6e', '486081c6-40f9-4037-bbac-d79aa43bc6ba', '96dec596-ce20-4e59-afea-1efcdb29046c', '58f5fc79-a295-4a46-aa9c-21dc153bffd7'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:10 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:16:10 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:10 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8" returned: 0 in 1.301s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:10 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8 Jun 24 00:16:10 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:11 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.291s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:11 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:16:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Deleted volume successfully. Jun 24 00:16:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-22ef21c4-325b-4613-8cfa-9bab60a85a9d tempest-DeleteServersTestJSON-1724122685 None] Lock "cinder-66b2d6c8-e22d-4f4d-ac4c-4c0ce4eeccce-delete_volume" released by "delete_volume" :: held 4.289s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:12 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a23a7139-c195-4f67-b78e-7e09bf78e7d8" returned: 0 in 1.346s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-a23a7139-c195-4f67-b78e-7e09bf78e7d8" released by "delete_volume" :: held 2.718s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['648f0f67-8eea-49c7-9088-c930c98732fb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:16:12 devstack cinder-volume[94472]: WARNING cinder.quota [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2113299258 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2113299258, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:16:12 devstack cinder-volume[94472]: WARNING cinder.quota [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2113299258 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2113299258, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['b7866d61-e660-4ec4-9171-a11be053da80', '675ec2fd-74b6-44dd-a85d-10ad589fb896', '8055a97e-9953-47ed-96d6-07d68f1e538e', 'e0602084-57a3-4eb7-a81e-d3903830471d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:12 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:16:12 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:13 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.897s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:13 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:16:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a44769eb-da40-4b4b-83ae-f43519e863bd tempest-GroupSnapshotsTest-1657221829 None] Delete group completed successfully. Jun 24 00:16:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] group_snapshot 3c9f519b-215e-4ac0-a792-ee8361f4124d: deleting Jun 24 00:16:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] group_snapshot 3c9f519b-215e-4ac0-a792-ee8361f4124d: deleting {{(pid=94472) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 00:16:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-aecdb897-36e5-4441-a2e5-93ddc062e169" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-aecdb897-36e5-4441-a2e5-93ddc062e169" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-a610974e-9887-485a-ac41-31945aba37bb" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-a610974e-9887-485a-ac41-31945aba37bb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Deleting offline snapshot a610974e-9887-485a-ac41-31945aba37bb of volume aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:16:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] snapshot_file for this snap is: volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:16:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[628f1e65-d125-4f7d-baef-fbe2228c3421]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:14 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb Jun 24 00:16:14 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:15 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb" returned: 0 in 1.274s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aecdb897-36e5-4441-a2e5-93ddc062e169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:16:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[99123f7f-f7e1-48cf-85fb-a060f13f8643]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:15 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 Jun 24 00:16:15 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:16 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169" returned: 0 in 1.340s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:16 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb Jun 24 00:16:16 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Acquiring lock "cinder-3af04f9f-9097-43c2-aae1-e80b240ff699-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "cinder-3af04f9f-9097-43c2-aae1-e80b240ff699-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Acquiring lock "cinder-quobyte-3af04f9f-9097-43c2-aae1-e80b240ff699" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "cinder-quobyte-3af04f9f-9097-43c2-aae1-e80b240ff699" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d08331-267b-4222-ade9-4c5498b71cbd]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:18 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 Jun 24 00:16:18 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:18 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb" returned: 0 in 1.455s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:18 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb Jun 24 00:16:18 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:19 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699" returned: 0 in 1.210s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:19 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699 Jun 24 00:16:19 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:19 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169.a610974e-9887-485a-ac41-31945aba37bb" returned: 0 in 1.049s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-a610974e-9887-485a-ac41-31945aba37bb" released by "_delete_snapshot" :: held 5.359s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-aecdb897-36e5-4441-a2e5-93ddc062e169" released by "delete_snapshot" :: held 5.399s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:19 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=46,cinder:UPDATE=47,cinder:INSERT=6,cinder:DELETE=4 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:16:19 devstack cinder-volume[94472]: WARNING cinder.quota [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2113299258 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2113299258, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:16:19 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['0dbe9a37-928e-4d65-bec3-fd3c6b1b8c1c', '1b28dcdd-1665-46a2-af16-da9a47386867', '71c13068-68ea-4ad9-ad64-773175f07915', 'e8cfbcae-ca54-4587-816f-83af43c5fc01'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:16:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-51d0df61-c3a8-4c7e-934e-481d8d97f5dc tempest-GroupSnapshotsTest-1657221829 None] group_snapshot 3c9f519b-215e-4ac0-a792-ee8361f4124d: deleted successfully Jun 24 00:16:20 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3af04f9f-9097-43c2-aae1-e80b240ff699" returned: 0 in 0.942s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "cinder-quobyte-3af04f9f-9097-43c2-aae1-e80b240ff699" released by "delete_volume" :: held 2.217s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=54,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Created reservations ['1015273f-4beb-4f88-b855-f2a8338d37a1', '10eb8344-5462-4b0c-8417-fcdedf580506', '9b2e0e4b-2c89-479e-a5c1-9ac84a11b9b1', 'dea43026-55ce-40d2-8849-20107571b06a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:20 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:16:20 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-aecdb897-36e5-4441-a2e5-93ddc062e169" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-aecdb897-36e5-4441-a2e5-93ddc062e169" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc0d5f2-9d97-487c-b363-4d30c35ea9b2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:21 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.203s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:16:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Deleted volume successfully. Jun 24 00:16:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0f54edb8-41ea-4245-b1bd-1001f80df0f0 tempest-ServerRescueNegativeTestJSON-180808569 None] Lock "cinder-3af04f9f-9097-43c2-aae1-e80b240ff699-delete_volume" released by "delete_volume" :: held 3.754s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:21 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 Jun 24 00:16:21 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:22 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169" returned: 0 in 1.277s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:22 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169 Jun 24 00:16:22 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:23 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aecdb897-36e5-4441-a2e5-93ddc062e169" returned: 0 in 1.380s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-aecdb897-36e5-4441-a2e5-93ddc062e169" released by "delete_volume" :: held 2.786s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['3cb2d94d-6d6f-4da5-839e-3673b6aaf049'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:16:24 devstack cinder-volume[94472]: WARNING cinder.db.api [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2113299258'] Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['d6e1b172-dc0f-4735-9039-4fa079f39e20', '822d19ee-d758-473e-aa03-d752bbbf1284', '6754bb28-4124-4da0-a3d8-f307ea5a92da', '8894b44f-b2e3-4e89-93d3-4c4e960c5e7f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:24 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:16:24 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:25 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.230s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:25 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:16:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-df40600d-95b0-429c-872c-75c841d7eff8 tempest-GroupSnapshotsTest-1657221829 None] Delete group completed successfully. Jun 24 00:16:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a3ff44d8-0a69-45e8-b7c8-1c301f2ab665 tempest-GroupSnapshotsTest-1657221829 None] Group tempest-GroupSnapshotsTest-Group-1540576641: creating Jun 24 00:16:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a3ff44d8-0a69-45e8-b7c8-1c301f2ab665 tempest-GroupSnapshotsTest-1657221829 None] Group tempest-GroupSnapshotsTest-Group-1540576641: created successfully Jun 24 00:16:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a3ff44d8-0a69-45e8-b7c8-1c301f2ab665 tempest-GroupSnapshotsTest-1657221829 None] Create group completed successfully. Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Flow 'volume_create_manager' (f6ba8245-e579-433b-becb-e6e997ff5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7624779-b0f4-4302-8b91-7ebc574abfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7624779-b0f4-4302-8b91-7ebc574abfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-94914349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cff8ab1a-2ad7-4d7f-bd06-6cac8ce4a137,host='devstack@QuobyteHD#QuobyteHD',id=39918e38-9f23-4740-8c5c-c9e8835cbc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afad6dfc2e5644408d647909f614faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:16:28Z,use_quota=True,user_id='934200a5c7354dab9067820b552ffff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c72e975-7574-4e37-a633-b0679acf8dfe),volume_type_id=7c72e975-7574-4e37-a633-b0679acf8dfe)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae98e731-6292-4f3b-a557-2e7d7fe587b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae98e731-6292-4f3b-a557-2e7d7fe587b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbe7ae8-0eaa-4ed6-a97d-da63d899b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbe7ae8-0eaa-4ed6-a97d-da63d899b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39918e38-9f23-4740-8c5c-c9e8835cbc23', 'volume_name': 'volume-39918e38-9f23-4740-8c5c-c9e8835cbc23', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061711e2-86f3-443f-b55b-5b0ce1c7b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061711e2-86f3-443f-b55b-5b0ce1c7b67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05754be-2391-4165-a179-3a292a5f3c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Volume 39918e38-9f23-4740-8c5c-c9e8835cbc23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39918e38-9f23-4740-8c5c-c9e8835cbc23', 'volume_size': 1} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cff8ab1a-2ad7-4d7f-bd06-6cac8ce4a137,created_at=2026-06-23T22:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-94914349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cff8ab1a-2ad7-4d7f-bd06-6cac8ce4a137,host='devstack@QuobyteHD#QuobyteHD',id=39918e38-9f23-4740-8c5c-c9e8835cbc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afad6dfc2e5644408d647909f614faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:16:28Z,use_quota=True,user_id='934200a5c7354dab9067820b552ffff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c72e975-7574-4e37-a633-b0679acf8dfe),volume_type_id=7c72e975-7574-4e37-a633-b0679acf8dfe)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Creating volume 39918e38-9f23-4740-8c5c-c9e8835cbc23 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:16:28 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:16:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:28 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 1073741824 Jun 24 00:16:28 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:29 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 1073741824" returned: 0 in 1.177s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:29 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 Jun 24 00:16:29 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:30 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23" returned: 0 in 0.770s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:16:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05754be-2391-4165-a179-3a292a5f3c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39918e38-9f23-4740-8c5c-c9e8835cbc23', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c3efe6-83c6-44f7-a189-2f4a599827f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Volume volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 (39918e38-9f23-4740-8c5c-c9e8835cbc23): created successfully Jun 24 00:16:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c3efe6-83c6-44f7-a189-2f4a599827f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Flow 'volume_create_manager' (f6ba8245-e579-433b-becb-e6e997ff5e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:16:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-05cd53a5-a67d-410f-9bc4-560b32213ff1 tempest-GroupSnapshotsTest-1657221829 None] Created volume successfully. Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Flow 'volume_create_manager' (e26f9e30-660c-4620-9c97-bde54915f3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42a6cee-3733-47bf-ba20-701d1336b231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42a6cee-3733-47bf-ba20-701d1336b231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1800622772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cff8ab1a-2ad7-4d7f-bd06-6cac8ce4a137,host='devstack@QuobyteHD#QuobyteHD',id=21fc44c0-9f84-4fc3-b65f-efca3479ec92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afad6dfc2e5644408d647909f614faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:16:32Z,use_quota=True,user_id='934200a5c7354dab9067820b552ffff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c72e975-7574-4e37-a633-b0679acf8dfe),volume_type_id=7c72e975-7574-4e37-a633-b0679acf8dfe)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fac89e0-8850-44a0-8f03-f221b5016043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fac89e0-8850-44a0-8f03-f221b5016043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a571bd-5494-44f9-bbee-3e1b33ff4664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a571bd-5494-44f9-bbee-3e1b33ff4664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21fc44c0-9f84-4fc3-b65f-efca3479ec92', 'volume_name': 'volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c20e305-926f-43db-8456-f95b4b8d1156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c20e305-926f-43db-8456-f95b4b8d1156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bfd785-04b8-419b-885c-e9869dfea8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:31 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Volume 21fc44c0-9f84-4fc3-b65f-efca3479ec92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92', 'volume_size': 1} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cff8ab1a-2ad7-4d7f-bd06-6cac8ce4a137,created_at=2026-06-23T22:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1800622772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cff8ab1a-2ad7-4d7f-bd06-6cac8ce4a137,host='devstack@QuobyteHD#QuobyteHD',id=21fc44c0-9f84-4fc3-b65f-efca3479ec92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afad6dfc2e5644408d647909f614faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:16:32Z,use_quota=True,user_id='934200a5c7354dab9067820b552ffff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c72e975-7574-4e37-a633-b0679acf8dfe),volume_type_id=7c72e975-7574-4e37-a633-b0679acf8dfe)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Creating volume 21fc44c0-9f84-4fc3-b65f-efca3479ec92 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:16:31 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:16:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:31 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 1073741824 Jun 24 00:16:31 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:33 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 1073741824" returned: 0 in 1.311s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:33 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 Jun 24 00:16:33 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:33 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92" returned: 0 in 0.744s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bfd785-04b8-419b-885c-e9869dfea8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fe9f0c-e6bf-424b-93a1-bf5073ac9019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:16:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Volume volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 (21fc44c0-9f84-4fc3-b65f-efca3479ec92): created successfully Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fe9f0c-e6bf-424b-93a1-bf5073ac9019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:16:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Flow 'volume_create_manager' (e26f9e30-660c-4620-9c97-bde54915f3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:16:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-886c8afb-8abd-448d-9498-f214c867a8c3 tempest-GroupSnapshotsTest-1657221829 None] Created volume successfully. Jun 24 00:16:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e72c8755-6bfc-4826-9688-2833b6f2ab11 tempest-GroupSnapshotsTest-1657221829 None] Update group completed successfully. Jun 24 00:16:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9d6ac568-0bb1-4768-b41e-4576a0a73f30 tempest-GroupSnapshotsTest-1657221829 None] Update group completed successfully. Jun 24 00:16:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f969c781-fd9e-4ed3-a2ad-e0908522a262 tempest-GroupSnapshotsTest-1657221829 None] Update group completed successfully. Jun 24 00:16:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e211db98-f516-4668-b469-5862725bed0e tempest-GroupSnapshotsTest-1657221829 None] Update group completed successfully. Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:39 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:16:39 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] GroupSnapshot 76599a7d-27ed-4f64-9b61-c46700293237: creating. Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Group snapshot 76599a7d-27ed-4f64-9b61-c46700293237: creating. {{(pid=94472) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Creating offline snapshot 0946cb1c-6fdd-4bac-8053-908cb76db2dd of volume 39918e38-9f23-4740-8c5c-c9e8835cbc23 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba48acd2-06c9-4d78-b3af-2a5b72f9daaa]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:40 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 Jun 24 00:16:40 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:40 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.971s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:16:41 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23" returned: 0 in 1.185s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:41 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd 1G Jun 24 00:16:41 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:42 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd 1G" returned: 0 in 1.278s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:42 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd Jun 24 00:16:42 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:43 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd" returned: 0 in 1.051s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:43 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:16:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:43 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd Jun 24 00:16:43 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:44 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd" returned: 0 in 0.836s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:44 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.info Jun 24 00:16:44 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:45 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.info" returned: 0 in 0.944s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:45 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:16:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:45 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.info Jun 24 00:16:45 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:45 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.info" returned: 0 in 0.779s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.178s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:16:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:16:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Creating offline snapshot eff48764-036d-46e1-b2d4-d0bf0a82e38c of volume 21fc44c0-9f84-4fc3-b65f-efca3479ec92 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:16:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a42ddf-ecba-46b7-a262-9114b577d8b1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:46 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 Jun 24 00:16:46 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:47 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92" returned: 0 in 0.990s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:47 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c 1G Jun 24 00:16:47 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:48 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c 1G" returned: 0 in 1.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:48 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c Jun 24 00:16:48 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:49 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c" returned: 0 in 0.872s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:49 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:16:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:49 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c Jun 24 00:16:49 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:49 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c" returned: 0 in 0.782s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:49 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.info Jun 24 00:16:49 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:50 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.info" returned: 0 in 0.910s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:50 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:16:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:50 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.info Jun 24 00:16:50 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:51 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.info" returned: 0 in 0.804s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.710s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:16:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-73ed62d1-ef42-4093-9f5a-7a56a69be2a8 tempest-GroupSnapshotsTest-1657221829 None] group_snapshot 76599a7d-27ed-4f64-9b61-c46700293237: created successfully Jun 24 00:16:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] group_snapshot 76599a7d-27ed-4f64-9b61-c46700293237: deleting Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] group_snapshot 76599a7d-27ed-4f64-9b61-c46700293237: deleting {{(pid=94472) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-39918e38-9f23-4740-8c5c-c9e8835cbc23" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-39918e38-9f23-4740-8c5c-c9e8835cbc23" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-0946cb1c-6fdd-4bac-8053-908cb76db2dd" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-0946cb1c-6fdd-4bac-8053-908cb76db2dd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Deleting offline snapshot 0946cb1c-6fdd-4bac-8053-908cb76db2dd of volume 39918e38-9f23-4740-8c5c-c9e8835cbc23 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] snapshot_file for this snap is: volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[646ae5eb-596f-4385-9363-f9a8fc8c6471]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:53 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd Jun 24 00:16:53 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:53 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd" returned: 0 in 0.803s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39918e38-9f23-4740-8c5c-c9e8835cbc23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:16:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c421e6-0157-49f8-a45c-2981832c59cc]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:53 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 Jun 24 00:16:53 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:54 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23" returned: 0 in 0.846s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:54 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd Jun 24 00:16:54 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:55 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd" returned: 0 in 1.099s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:55 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd Jun 24 00:16:55 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:56 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23.0946cb1c-6fdd-4bac-8053-908cb76db2dd" returned: 0 in 0.848s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-0946cb1c-6fdd-4bac-8053-908cb76db2dd" released by "_delete_snapshot" :: held 3.724s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-39918e38-9f23-4740-8c5c-c9e8835cbc23" released by "delete_snapshot" :: held 3.755s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-21fc44c0-9f84-4fc3-b65f-efca3479ec92" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-21fc44c0-9f84-4fc3-b65f-efca3479ec92" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-eff48764-036d-46e1-b2d4-d0bf0a82e38c" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-eff48764-036d-46e1-b2d4-d0bf0a82e38c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Deleting offline snapshot eff48764-036d-46e1-b2d4-d0bf0a82e38c of volume 21fc44c0-9f84-4fc3-b65f-efca3479ec92 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] snapshot_file for this snap is: volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04fb824-f544-45ed-82bf-fc7403fd7f9a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:56 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c Jun 24 00:16:56 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:57 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c" returned: 0 in 0.853s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:16:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdda78dc-f3e0-4558-9ade-40cb9dc5c828]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:16:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:57 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 Jun 24 00:16:57 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:58 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92" returned: 0 in 1.007s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:58 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c Jun 24 00:16:58 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:16:59 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jun 24 00:16:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c" returned: 0 in 0.972s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:16:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:16:59 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c Jun 24 00:16:59 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Flow 'volume_create_manager' (ee8041e1-7649-4e94-bacb-619a04e82d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877adb3e-d211-4c4e-a5c9-a840954d10c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877adb3e-d211-4c4e-a5c9-a840954d10c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1043714977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954bdf18-d622-4ade-a996-bb4c07a6a949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b9436587674f8fac94f0bbe61671a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:17:00Z,use_quota=True,user_id='c722da39c9c74a74988b87652a32892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65727480-56eb-40fe-b739-0cba190f3d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65727480-56eb-40fe-b739-0cba190f3d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2854e295-a14b-48cd-9a4a-bee7eeacafeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2854e295-a14b-48cd-9a4a-bee7eeacafeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954bdf18-d622-4ade-a996-bb4c07a6a949', 'volume_name': 'volume-954bdf18-d622-4ade-a996-bb4c07a6a949', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439c0982-e11c-4792-9b41-27973112d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439c0982-e11c-4792-9b41-27973112d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82d8480-d338-465e-ac10-d13e8f841ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Volume 954bdf18-d622-4ade-a996-bb4c07a6a949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954bdf18-d622-4ade-a996-bb4c07a6a949', 'volume_size': 1} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1043714977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954bdf18-d622-4ade-a996-bb4c07a6a949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b9436587674f8fac94f0bbe61671a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:17:00Z,use_quota=True,user_id='c722da39c9c74a74988b87652a32892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Creating volume 954bdf18-d622-4ade-a996-bb4c07a6a949 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:17:00 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:00 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 1073741824 Jun 24 00:17:00 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:00 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92.eff48764-036d-46e1-b2d4-d0bf0a82e38c" returned: 0 in 1.071s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-eff48764-036d-46e1-b2d4-d0bf0a82e38c" released by "_delete_snapshot" :: held 4.063s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-21fc44c0-9f84-4fc3-b65f-efca3479ec92" released by "delete_snapshot" :: held 4.100s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:17:00 devstack cinder-volume[94472]: WARNING cinder.quota [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2061642163 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2061642163, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:17:00 devstack cinder-volume[94472]: WARNING cinder.quota [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2061642163 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2061642163, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:17:00 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['640bee73-d038-4979-b040-bf9fd67fe071', '0b84ae97-4fd8-42b0-9853-a3eedc894c86', '23b7001c-7617-4a42-af96-c085bf4e044c', '9b446601-ec89-47f1-afd5-70004db2c829'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:17:01 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['700840e4-a508-4f04-9a3c-707062fb2b2c', 'ce3013f5-3a02-4b1b-be7e-2322425c2e79', '8d33cb4d-06b6-488e-b2af-c1df514be57a', 'b8ca4d2f-e679-4339-a993-83ab7abf2950'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:17:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-57e69e26-d278-4a88-9b9c-14a0c15e45da tempest-GroupSnapshotsTest-1657221829 None] group_snapshot 76599a7d-27ed-4f64-9b61-c46700293237: deleted successfully Jun 24 00:17:01 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 1073741824" returned: 0 in 1.094s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:01 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 Jun 24 00:17:01 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-21fc44c0-9f84-4fc3-b65f-efca3479ec92" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:17:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-21fc44c0-9f84-4fc3-b65f-efca3479ec92" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:17:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3be6a-565c-4780-a331-30f60a5d99e1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:17:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:02 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 Jun 24 00:17:02 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:03 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949" returned: 0 in 1.274s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] <== create_volume: return (2423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82d8480-d338-465e-ac10-d13e8f841ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954bdf18-d622-4ade-a996-bb4c07a6a949', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1912ded9-7952-4fcc-9fa2-79ffd31bcad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Volume volume-954bdf18-d622-4ade-a996-bb4c07a6a949 (954bdf18-d622-4ade-a996-bb4c07a6a949): created successfully Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1912ded9-7952-4fcc-9fa2-79ffd31bcad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Flow 'volume_create_manager' (ee8041e1-7649-4e94-bacb-619a04e82d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:17:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0ee32d00-1714-4947-8c52-add37c0e13e4 tempest-TaggedAttachmentsTest-1798809105 None] Created volume successfully. Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92" returned: 0 in 1.045s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:03 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:03 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92 Jun 24 00:17:03 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:04 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-21fc44c0-9f84-4fc3-b65f-efca3479ec92" returned: 0 in 1.287s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-21fc44c0-9f84-4fc3-b65f-efca3479ec92" released by "delete_volume" :: held 2.456s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:17:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-39918e38-9f23-4740-8c5c-c9e8835cbc23" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:17:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-39918e38-9f23-4740-8c5c-c9e8835cbc23" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:17:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6cfb60-8908-48d5-b2d5-18d6371407a5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:17:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:05 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 Jun 24 00:17:05 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:06 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23" returned: 0 in 1.405s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:06 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23 Jun 24 00:17:06 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:07 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39918e38-9f23-4740-8c5c-c9e8835cbc23" returned: 0 in 1.628s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-39918e38-9f23-4740-8c5c-c9e8835cbc23" released by "delete_volume" :: held 3.177s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['8e304f59-e8ae-4091-8af5-eb6cc7569a77'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:17:08 devstack cinder-volume[94472]: WARNING cinder.quota [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2061642163 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2061642163, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['d902de99-f428-4680-a6e5-584674d01f5c', 'f772a916-f8b5-43eb-a31b-a9949df7250c', '177e91f1-ffc8-4c86-9c5b-70c44590cf74', 'a1009622-931f-4600-8d4e-f9b9c356024c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['0e7b9bc5-7477-4d2f-9301-ac7aacad2989', 'dfc0ee36-1b1a-4a42-a090-5e6ae9a2f3eb', 'ad868b6b-6235-443d-b766-4925edfbb8c0', '3d993890-16c6-4a72-a67a-bb7d0966c2ed'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:08 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:17:08 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:09 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.188s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:09 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:17:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4d951bb2-31c0-4592-aa96-5afcf5712e60 tempest-GroupSnapshotsTest-1657221829 None] Delete group completed successfully. Jun 24 00:17:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-14784670-fe96-41be-9496-1e7506eda73b tempest-GroupSnapshotsTest-1657221829 None] Group tempest-GroupSnapshotsTest-Group-1028538930: creating Jun 24 00:17:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-14784670-fe96-41be-9496-1e7506eda73b tempest-GroupSnapshotsTest-1657221829 None] Group tempest-GroupSnapshotsTest-Group-1028538930: created successfully Jun 24 00:17:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-14784670-fe96-41be-9496-1e7506eda73b tempest-GroupSnapshotsTest-1657221829 None] Create group completed successfully. Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Flow 'volume_create_manager' (cffe5541-8028-424e-b664-caaf9334f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba6a155-ea0a-4eed-b7f1-e597e4fc3853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba6a155-ea0a-4eed-b7f1-e597e4fc3853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-17727748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eca915a8-0e62-444a-ad3f-14c8ea9f00a9,host='devstack@QuobyteHD#QuobyteHD',id=022e0eee-11d4-4182-a7cf-3db3a042e7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afad6dfc2e5644408d647909f614faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:17:12Z,use_quota=True,user_id='934200a5c7354dab9067820b552ffff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe27eca3-730a-44aa-b77e-297d98fc130f),volume_type_id=fe27eca3-730a-44aa-b77e-297d98fc130f)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c752dc0-1a4b-468f-97df-09b37a051670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c752dc0-1a4b-468f-97df-09b37a051670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be15ff9-9e05-49b8-8e88-d59d394985fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be15ff9-9e05-49b8-8e88-d59d394985fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022e0eee-11d4-4182-a7cf-3db3a042e7d7', 'volume_name': 'volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea65c647-22dd-4403-85f6-13b706ac3141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea65c647-22dd-4403-85f6-13b706ac3141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14944777-209d-4688-8562-e099cd0c70dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Volume 022e0eee-11d4-4182-a7cf-3db3a042e7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7', 'volume_size': 1} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eca915a8-0e62-444a-ad3f-14c8ea9f00a9,created_at=2026-06-23T22:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-17727748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eca915a8-0e62-444a-ad3f-14c8ea9f00a9,host='devstack@QuobyteHD#QuobyteHD',id=022e0eee-11d4-4182-a7cf-3db3a042e7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afad6dfc2e5644408d647909f614faf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:17:12Z,use_quota=True,user_id='934200a5c7354dab9067820b552ffff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe27eca3-730a-44aa-b77e-297d98fc130f),volume_type_id=fe27eca3-730a-44aa-b77e-297d98fc130f)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Creating volume 022e0eee-11d4-4182-a7cf-3db3a042e7d7 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:17:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:17:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:12 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 1073741824 Jun 24 00:17:12 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:14 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 1073741824" returned: 0 in 1.565s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:14 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 Jun 24 00:17:14 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:15 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7" returned: 0 in 0.945s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] <== create_volume: return (2600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:17:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.602s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14944777-209d-4688-8562-e099cd0c70dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16f6688-3cb7-4d08-9e55-6411b7049067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Volume volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 (022e0eee-11d4-4182-a7cf-3db3a042e7d7): created successfully Jun 24 00:17:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16f6688-3cb7-4d08-9e55-6411b7049067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Flow 'volume_create_manager' (cffe5541-8028-424e-b664-caaf9334f99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:17:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f0262e72-347f-413f-9cd3-62a2eabe89a4 tempest-GroupSnapshotsTest-1657221829 None] Created volume successfully. Jun 24 00:17:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] GroupSnapshot f0285e33-8888-4a7d-a123-7ac11890c812: creating. Jun 24 00:17:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Group snapshot f0285e33-8888-4a7d-a123-7ac11890c812: creating. {{(pid=94472) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 00:17:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Creating offline snapshot d2ef8f94-c957-4882-bea9-058ea1418696 of volume 022e0eee-11d4-4182-a7cf-3db3a042e7d7 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:17:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[20335b40-0514-44b2-838c-76b7634e8e5b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:17:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:17 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 Jun 24 00:17:17 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:17 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7" returned: 0 in 0.982s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:17 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 1G Jun 24 00:17:17 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:19 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 1G" returned: 0 in 1.478s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:19 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 Jun 24 00:17:19 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:20 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696" returned: 0 in 0.820s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:20 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:17:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:20 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 Jun 24 00:17:20 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:20 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696" returned: 0 in 0.706s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:20 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=71,cinder:INSERT=16,cinder:UPDATE=76,cinder:DELETE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:17:20 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=65,cinder:INSERT=17,cinder:UPDATE=70,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:17:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:21 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.info Jun 24 00:17:21 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:21 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.info" returned: 0 in 0.723s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:21 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:17:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:21 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.info Jun 24 00:17:21 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:22 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.info" returned: 0 in 0.743s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.646s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-639a3c29-b504-4774-91ae-4d715f7b3f0a tempest-GroupSnapshotsTest-1657221829 None] group_snapshot f0285e33-8888-4a7d-a123-7ac11890c812: created successfully Jun 24 00:17:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] group_snapshot f0285e33-8888-4a7d-a123-7ac11890c812: deleting Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] group_snapshot f0285e33-8888-4a7d-a123-7ac11890c812: deleting {{(pid=94472) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-022e0eee-11d4-4182-a7cf-3db3a042e7d7" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-022e0eee-11d4-4182-a7cf-3db3a042e7d7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-d2ef8f94-c957-4882-bea9-058ea1418696" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-d2ef8f94-c957-4882-bea9-058ea1418696" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Deleting offline snapshot d2ef8f94-c957-4882-bea9-058ea1418696 of volume 022e0eee-11d4-4182-a7cf-3db3a042e7d7 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] snapshot_file for this snap is: volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b56e63-648b-4db1-84f3-3213b1625c1f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:17:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:23 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 Jun 24 00:17:23 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:24 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696" returned: 0 in 0.914s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:17:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dafb54d-9fc1-41ba-b028-ae8be4fd6893]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:17:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:24 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 Jun 24 00:17:24 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:25 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7" returned: 0 in 0.780s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:25 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 Jun 24 00:17:25 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:25 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696" returned: 0 in 0.715s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:25 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696 Jun 24 00:17:25 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:26 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7.d2ef8f94-c957-4882-bea9-058ea1418696" returned: 0 in 0.678s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-d2ef8f94-c957-4882-bea9-058ea1418696" released by "_delete_snapshot" :: held 3.273s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:17:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-022e0eee-11d4-4182-a7cf-3db3a042e7d7" released by "delete_snapshot" :: held 3.298s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:17:26 devstack cinder-volume[94472]: WARNING cinder.quota [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2016249595 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2016249595, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:17:26 devstack cinder-volume[94472]: WARNING cinder.quota [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2016249595 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2016249595, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:17:26 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['fda14dfb-e1d6-4cf0-9cbc-e93933acdde0', '4b941416-5164-44de-bd4a-a2431314edf2', '649a8491-676f-47e5-bdda-03078e2c596d', '81756e9d-0580-4884-807c-e4522255498c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:17:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-96396817-9bc8-418c-90ac-965eaa14c5d6 tempest-GroupSnapshotsTest-1657221829 None] group_snapshot f0285e33-8888-4a7d-a123-7ac11890c812: deleted successfully Jun 24 00:17:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "cinder-quobyte-022e0eee-11d4-4182-a7cf-3db3a042e7d7" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:17:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-022e0eee-11d4-4182-a7cf-3db3a042e7d7" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:17:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[67241c1c-da4e-4014-92ae-bf143b48f93c]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:17:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:28 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 Jun 24 00:17:28 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:29 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7" returned: 0 in 0.895s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:29 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7 Jun 24 00:17:29 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:29 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Flow 'volume_create_manager' (62428379-ddf1-4c21-a649-0b2cf500a6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b412315-fd70-4c83-8090-85d53c1aa291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b412315-fd70-4c83-8090-85d53c1aa291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1908242381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6c5a45-a262-4297-8d95-3b77fb1213ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5863939552e548e48affb064c274cfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:17:30Z,use_quota=True,user_id='1eaece89cc804ff78fe6122c20b0cd37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5c372c-554e-4b93-ac2e-21cc914280a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5c372c-554e-4b93-ac2e-21cc914280a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc5b819-8272-4917-872e-e93dfcf2944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc5b819-8272-4917-872e-e93dfcf2944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6c5a45-a262-4297-8d95-3b77fb1213ab', 'volume_name': 'volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34552517-f13d-42f6-a873-95e6f4f2a15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34552517-f13d-42f6-a873-95e6f4f2a15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a28d06-1796-4fd1-be5f-8d46478ca4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Volume ef6c5a45-a262-4297-8d95-3b77fb1213ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab', 'volume_size': 1} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1908242381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6c5a45-a262-4297-8d95-3b77fb1213ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5863939552e548e48affb064c274cfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:17:30Z,use_quota=True,user_id='1eaece89cc804ff78fe6122c20b0cd37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Creating volume ef6c5a45-a262-4297-8d95-3b77fb1213ab {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:17:30 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:17:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:30 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab 1073741824 Jun 24 00:17:30 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:31 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-022e0eee-11d4-4182-a7cf-3db3a042e7d7" returned: 0 in 1.923s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Lock "cinder-quobyte-022e0eee-11d4-4182-a7cf-3db3a042e7d7" released by "delete_volume" :: held 3.000s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:17:31 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['2aeac215-a93d-4774-96be-f88ccd785c04'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:17:31 devstack cinder-volume[94472]: WARNING cinder.quota [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2016249595 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2016249595, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Created reservations ['9f14bb85-d4da-4648-b8d8-a858af33cc18', '6e679826-a528-41e4-a5f3-375b31260d2f', 'b3cd1040-e44e-4d3e-8d58-eae9b4c8a545', 'b09ca4fd-bbf1-4f0c-b7e3-4bb923eeb977'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:32 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:17:32 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:32 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab 1073741824" returned: 0 in 2.398s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:32 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab Jun 24 00:17:32 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:33 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.421s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:33 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:17:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c3060f7e-7282-4a22-be25-4fa92a3a0240 tempest-GroupSnapshotsTest-1657221829 None] Delete group completed successfully. Jun 24 00:17:34 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab" returned: 0 in 1.939s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] <== create_volume: return (4496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:17:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.499s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a28d06-1796-4fd1-be5f-8d46478ca4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b487b5e-dfa6-419c-a8d5-f57f6ffb2159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:17:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Volume volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab (ef6c5a45-a262-4297-8d95-3b77fb1213ab): created successfully Jun 24 00:17:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b487b5e-dfa6-419c-a8d5-f57f6ffb2159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:17:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Flow 'volume_create_manager' (62428379-ddf1-4c21-a649-0b2cf500a6e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:17:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-70d01712-1aab-43f0-9c14-b42de5fc0cf3 tempest-ServerActionsTestOtherA-1144166643 None] Created volume successfully. Jun 24 00:17:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:17:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:17:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:17:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:17:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:17:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:17:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:17:39 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:17:39 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:17:40 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jun 24 00:17:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:17:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:17:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:17:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 8 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:17:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:17:44 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=21,cinder:INSERT=9,cinder:UPDATE=21 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:17:44 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=22,cinder:SELECT=20,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Flow 'volume_create_manager' (ea0d5981-3ffc-48ce-86c7-136d08efe0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30679d72-86f0-411b-bafa-049ae6f4d1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30679d72-86f0-411b-bafa-049ae6f4d1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1784394980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4087ebbb-8417-4eeb-bc07-9adba315efc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bd9176d4fe4043b8c9f4a788037091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:02Z,use_quota=True,user_id='cf32e9647cc14d528d08339d37f66fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e68848-216f-4b0c-94c0-4388e19c098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e68848-216f-4b0c-94c0-4388e19c098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024eb9e2-f6e6-411b-9f11-0a8376b05edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024eb9e2-f6e6-411b-9f11-0a8376b05edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4087ebbb-8417-4eeb-bc07-9adba315efc5', 'volume_name': 'volume-4087ebbb-8417-4eeb-bc07-9adba315efc5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e465cf55-1cf2-417b-a773-3b321cabd251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e465cf55-1cf2-417b-a773-3b321cabd251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a645ac-bfa5-4d64-b48d-10675eeedfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Volume 4087ebbb-8417-4eeb-bc07-9adba315efc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4087ebbb-8417-4eeb-bc07-9adba315efc5', 'volume_size': 1} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1784394980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4087ebbb-8417-4eeb-bc07-9adba315efc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bd9176d4fe4043b8c9f4a788037091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:02Z,use_quota=True,user_id='cf32e9647cc14d528d08339d37f66fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Creating volume 4087ebbb-8417-4eeb-bc07-9adba315efc5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:18:02 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:18:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:02 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 1073741824 Jun 24 00:18:02 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:03 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 1073741824" returned: 0 in 1.195s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:04 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 Jun 24 00:18:04 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:04 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5" returned: 0 in 0.705s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:18:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a645ac-bfa5-4d64-b48d-10675eeedfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4087ebbb-8417-4eeb-bc07-9adba315efc5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307be60f-6ca2-4087-ab4c-cc5aa901604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Volume volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 (4087ebbb-8417-4eeb-bc07-9adba315efc5): created successfully Jun 24 00:18:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307be60f-6ca2-4087-ab4c-cc5aa901604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Flow 'volume_create_manager' (ea0d5981-3ffc-48ce-86c7-136d08efe0dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3eb0b005-ff88-4ede-807b-be2b7b805f54 tempest-AttachVolumeShelveTestJSON-1540736578 None] Created volume successfully. Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Flow 'volume_create_manager' (1e9de588-47ff-46e9-a44e-552e8b7d0f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b67af79-a44c-487e-a96b-a5c707c202cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b67af79-a44c-487e-a96b-a5c707c202cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-624427412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e25fdf5-25fd-4084-9a37-726df4c0bde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b265482d4d47f59f5210659f5366a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:09Z,use_quota=True,user_id='e8cc2ee5b8a74ac6817b364065de2e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0444c9c0-4384-4e08-8840-db1d2af1b6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0444c9c0-4384-4e08-8840-db1d2af1b6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8891b046-3145-4925-bd6d-55f3ba0b8392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8891b046-3145-4925-bd6d-55f3ba0b8392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e25fdf5-25fd-4084-9a37-726df4c0bde5', 'volume_name': 'volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baef42ec-de27-47f2-9fc3-41592e2b7fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baef42ec-de27-47f2-9fc3-41592e2b7fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7000bbb7-eab0-434d-bd77-1dd0e520b3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Volume 2e25fdf5-25fd-4084-9a37-726df4c0bde5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5', 'volume_size': 1} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-624427412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e25fdf5-25fd-4084-9a37-726df4c0bde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b265482d4d47f59f5210659f5366a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:09Z,use_quota=True,user_id='e8cc2ee5b8a74ac6817b364065de2e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Creating volume 2e25fdf5-25fd-4084-9a37-726df4c0bde5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:18:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:18:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:09 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 1073741824 Jun 24 00:18:09 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:10 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 1073741824" returned: 0 in 1.053s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:10 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 Jun 24 00:18:10 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:11 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5" returned: 0 in 0.649s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7000bbb7-eab0-434d-bd77-1dd0e520b3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafc444f-ebb6-4842-98d4-6fb6737e8a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Volume volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 (2e25fdf5-25fd-4084-9a37-726df4c0bde5): created successfully Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafc444f-ebb6-4842-98d4-6fb6737e8a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Flow 'volume_create_manager' (1e9de588-47ff-46e9-a44e-552e8b7d0f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-72f45825-a943-4371-ab20-99a8e7dfb89d tempest-VolumeQuotasAdminTestJSON-738891574 None] Created volume successfully. Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Acquiring lock "cinder-2e25fdf5-25fd-4084-9a37-726df4c0bde5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "cinder-2e25fdf5-25fd-4084-9a37-726df4c0bde5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Acquiring lock "cinder-quobyte-2e25fdf5-25fd-4084-9a37-726df4c0bde5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "cinder-quobyte-2e25fdf5-25fd-4084-9a37-726df4c0bde5" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c1ebf7-2ec4-4ef1-80f5-3997e6a7e226]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:18:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:11 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 Jun 24 00:18:11 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:12 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5" returned: 0 in 0.834s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:12 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5 Jun 24 00:18:12 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:13 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2e25fdf5-25fd-4084-9a37-726df4c0bde5" returned: 0 in 0.721s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "cinder-quobyte-2e25fdf5-25fd-4084-9a37-726df4c0bde5" released by "delete_volume" :: held 1.607s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Created reservations ['fecf67d7-a2d7-4b32-a229-ad5dbd69a973', '44b53348-0cb5-4c90-94d6-7585ae1a4347', '540710ba-f530-48f1-9d33-7493459f85c0', '694277a2-5230-4318-a6c6-ce77a6979441'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:13 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:18:13 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-3b408084-7752-47c9-bee2-00cccd372f41 req-11c2d6ea-b10c-4ae2-91a1-97b3c1e29e60 tempest-TaggedAttachmentsTest-1798809105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-3b408084-7752-47c9-bee2-00cccd372f41 req-11c2d6ea-b10c-4ae2-91a1-97b3c1e29e60 tempest-TaggedAttachmentsTest-1798809105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614f289-3659-4c5e-bea3-a175b68f53b9]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:18:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3b408084-7752-47c9-bee2-00cccd372f41 req-11c2d6ea-b10c-4ae2-91a1-97b3c1e29e60 tempest-TaggedAttachmentsTest-1798809105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:14 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 Jun 24 00:18:14 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:14 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.970s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:18:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Deleted volume successfully. Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-71f574e0-6832-4e6c-9212-8b6b4d5338a1 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "cinder-2e25fdf5-25fd-4084-9a37-726df4c0bde5-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Flow 'volume_create_manager' (2adce259-094f-4eab-a764-f14e481757a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f648dd5a-9e0a-4de6-aeff-66bae9629c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f648dd5a-9e0a-4de6-aeff-66bae9629c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-555333363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8806c4-861f-429f-8927-88c7120896b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b265482d4d47f59f5210659f5366a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:15Z,use_quota=True,user_id='e8cc2ee5b8a74ac6817b364065de2e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5485f15-2aa3-4953-ab48-439ecdd9fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5485f15-2aa3-4953-ab48-439ecdd9fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3dc758-f4a0-44b9-8636-8d0f34d6e8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3dc758-f4a0-44b9-8636-8d0f34d6e8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8806c4-861f-429f-8927-88c7120896b3', 'volume_name': 'volume-fd8806c4-861f-429f-8927-88c7120896b3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf95646-196b-4466-be70-1400615a0df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf95646-196b-4466-be70-1400615a0df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353e6c3d-7684-4cb3-be92-96d52377fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Volume fd8806c4-861f-429f-8927-88c7120896b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8806c4-861f-429f-8927-88c7120896b3', 'volume_size': 1} Jun 24 00:18:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:15 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3b408084-7752-47c9-bee2-00cccd372f41 req-11c2d6ea-b10c-4ae2-91a1-97b3c1e29e60 tempest-TaggedAttachmentsTest-1798809105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949" returned: 0 in 1.209s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-3b408084-7752-47c9-bee2-00cccd372f41 req-11c2d6ea-b10c-4ae2-91a1-97b3c1e29e60 tempest-TaggedAttachmentsTest-1798809105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.248s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.271s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-555333363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8806c4-861f-429f-8927-88c7120896b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b265482d4d47f59f5210659f5366a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:15Z,use_quota=True,user_id='e8cc2ee5b8a74ac6817b364065de2e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Creating volume fd8806c4-861f-429f-8927-88c7120896b3 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:18:15 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:15 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 1073741824 Jun 24 00:18:15 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-3b408084-7752-47c9-bee2-00cccd372f41 req-11c2d6ea-b10c-4ae2-91a1-97b3c1e29e60 tempest-TaggedAttachmentsTest-1798809105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-954bdf18-d622-4ade-a996-bb4c07a6a949', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee770ba8-0a38-427e-a6eb-c8f5d38a304b', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:18:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-3b408084-7752-47c9-bee2-00cccd372f41 req-11c2d6ea-b10c-4ae2-91a1-97b3c1e29e60 tempest-TaggedAttachmentsTest-1798809105 None] attachment_update completed successfully. Jun 24 00:18:16 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 1073741824" returned: 0 in 1.164s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:16 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 Jun 24 00:18:16 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:16 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3" returned: 0 in 0.692s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:18:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353e6c3d-7684-4cb3-be92-96d52377fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8806c4-861f-429f-8927-88c7120896b3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d5cc59-7423-4345-bd56-c3a57640d18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Volume volume-fd8806c4-861f-429f-8927-88c7120896b3 (fd8806c4-861f-429f-8927-88c7120896b3): created successfully Jun 24 00:18:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d5cc59-7423-4345-bd56-c3a57640d18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Flow 'volume_create_manager' (2adce259-094f-4eab-a764-f14e481757a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-64b2a487-ba56-4b7d-bda3-37deacdb5d44 tempest-VolumeQuotasAdminTestJSON-738891574 None] Created volume successfully. Jun 24 00:18:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-da6fc869-2052-4cb2-9f7d-701737aeb661 tempest-VolumeQuotasAdminTestJSON-925257501 None] Transfer volume completed successfully. Jun 24 00:18:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Acquiring lock "cinder-fd8806c4-861f-429f-8927-88c7120896b3-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Lock "cinder-fd8806c4-861f-429f-8927-88c7120896b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Acquiring lock "cinder-quobyte-fd8806c4-861f-429f-8927-88c7120896b3" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Lock "cinder-quobyte-fd8806c4-861f-429f-8927-88c7120896b3" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ea0552-e674-49a0-9743-ab5fcd522e84]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:18:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:19 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 Jun 24 00:18:19 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:20 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3" returned: 0 in 0.953s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:20 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3 Jun 24 00:18:20 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:21 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fd8806c4-861f-429f-8927-88c7120896b3" returned: 0 in 0.836s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Lock "cinder-quobyte-fd8806c4-861f-429f-8927-88c7120896b3" released by "delete_volume" :: held 1.848s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Created reservations ['a7fca320-f991-42cb-b99c-a162b66943d2', '0e440fd9-d70c-4db1-9bba-fb9be5e04fe8', 'ebbba422-0eae-4a0e-a96e-98660db69abc', 'ed9cccca-ff4a-4148-af58-f3f85506d248'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:21 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:18:21 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-9f556a72-bfab-4c7c-8088-3523a5bb371f req-d9b0f6cf-f489-4807-81a7-78e7b348c239 tempest-ServerActionsTestOtherA-1144166643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-9f556a72-bfab-4c7c-8088-3523a5bb371f req-d9b0f6cf-f489-4807-81a7-78e7b348c239 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e614c535-d085-4db0-a542-82e4cf289097]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:18:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-9f556a72-bfab-4c7c-8088-3523a5bb371f req-d9b0f6cf-f489-4807-81a7-78e7b348c239 tempest-ServerActionsTestOtherA-1144166643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:21 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab Jun 24 00:18:21 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:22 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.897s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:18:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Deleted volume successfully. Jun 24 00:18:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db14053e-7f22-4f13-9a20-66555f379d44 tempest-VolumeQuotasAdminTestJSON-1556212711 None] Lock "cinder-fd8806c4-861f-429f-8927-88c7120896b3-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-9b86b380-4e09-4e6e-b5bf-68e58b367566 req-0312721e-4c3f-4289-8eb3-8625b996ab75 tempest-TaggedAttachmentsTest-1798809105 None] Terminate volume connection completed successfully. Jun 24 00:18:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-9b86b380-4e09-4e6e-b5bf-68e58b367566 req-0312721e-4c3f-4289-8eb3-8625b996ab75 tempest-TaggedAttachmentsTest-1798809105 None] Deleting attachment ee770ba8-0a38-427e-a6eb-c8f5d38a304b. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:18:22 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-9f556a72-bfab-4c7c-8088-3523a5bb371f req-d9b0f6cf-f489-4807-81a7-78e7b348c239 tempest-ServerActionsTestOtherA-1144166643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab" returned: 0 in 1.059s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-9f556a72-bfab-4c7c-8088-3523a5bb371f req-d9b0f6cf-f489-4807-81a7-78e7b348c239 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.093s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-9f556a72-bfab-4c7c-8088-3523a5bb371f req-d9b0f6cf-f489-4807-81a7-78e7b348c239 tempest-ServerActionsTestOtherA-1144166643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb6eeb1b-0d46-403c-90f0-1821481dcdd6', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:18:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-9f556a72-bfab-4c7c-8088-3523a5bb371f req-d9b0f6cf-f489-4807-81a7-78e7b348c239 tempest-ServerActionsTestOtherA-1144166643 None] attachment_update completed successfully. Jun 24 00:18:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-853703be-07ac-4a44-9693-ec29376c1cc3 req-572f6d9f-869e-42d1-a0b5-6136056c6249 tempest-AttachVolumeShelveTestJSON-1540736578 None] No connector for attachment bf766bec-a396-4270-a7ec-757fa15e4019; skipping storage backend terminate_connection call. {{(pid=94472) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 24 00:18:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-853703be-07ac-4a44-9693-ec29376c1cc3 req-572f6d9f-869e-42d1-a0b5-6136056c6249 tempest-AttachVolumeShelveTestJSON-1540736578 None] Deleting attachment bf766bec-a396-4270-a7ec-757fa15e4019. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:18:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-40cb9e86-d4b7-4320-b984-8a8ae0ff4077 tempest-ServerActionsTestOtherA-1144166643 None] Terminate volume connection completed successfully. Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-40cb9e86-d4b7-4320-b984-8a8ae0ff4077 tempest-ServerActionsTestOtherA-1144166643 None] Deleting attachment fb6eeb1b-0d46-403c-90f0-1821481dcdd6. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Flow 'volume_create_manager' (bb2022f8-ae94-45f3-9ee1-0626371d0e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e00001-fc21-4521-b660-49d890276346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e00001-fc21-4521-b660-49d890276346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-561663589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1b3502-ae07-47f4-87d6-38ea272edf48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550965664e5e4277aec56aa4624ad6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:32Z,use_quota=True,user_id='7bfe0dbaa4434a9293853c39bb6c874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ae0fab-7749-47e9-894c-f7d85dab18e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ae0fab-7749-47e9-894c-f7d85dab18e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f81fef0-e4e9-4684-850d-af0658f0ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f81fef0-e4e9-4684-850d-af0658f0ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1b3502-ae07-47f4-87d6-38ea272edf48', 'volume_name': 'volume-cb1b3502-ae07-47f4-87d6-38ea272edf48', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672e566a-0463-4aba-9ad0-4bd52fe17a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672e566a-0463-4aba-9ad0-4bd52fe17a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72577d4-17b5-4e86-890f-eaa07f858b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Volume cb1b3502-ae07-47f4-87d6-38ea272edf48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1b3502-ae07-47f4-87d6-38ea272edf48', 'volume_size': 1} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-561663589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1b3502-ae07-47f4-87d6-38ea272edf48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550965664e5e4277aec56aa4624ad6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:32Z,use_quota=True,user_id='7bfe0dbaa4434a9293853c39bb6c874c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Creating volume cb1b3502-ae07-47f4-87d6-38ea272edf48 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:18:32 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:18:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:32 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 1073741824 Jun 24 00:18:32 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 1073741824" returned: 0 in 1.152s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:33 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:33 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 Jun 24 00:18:33 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:34 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48" returned: 0 in 0.875s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72577d4-17b5-4e86-890f-eaa07f858b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1b3502-ae07-47f4-87d6-38ea272edf48', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0da8ea8-0eea-4f34-bf9e-18730a5645a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Volume volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 (cb1b3502-ae07-47f4-87d6-38ea272edf48): created successfully Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0da8ea8-0eea-4f34-bf9e-18730a5645a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Flow 'volume_create_manager' (bb2022f8-ae94-45f3-9ee1-0626371d0e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-51c4d4b2-ae2d-4011-bd4b-c7d0b0787d01 tempest-VolumeQuotasNegativeTestJSON-136224940 None] Created volume successfully. Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-6c05355c-5d4c-4ad2-b33b-2b2b38468e81 tempest-ServerActionsTestOtherA-1144166643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-6c05355c-5d4c-4ad2-b33b-2b2b38468e81 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af73da1-f623-4c06-b4ce-556be20f6e58]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:18:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-6c05355c-5d4c-4ad2-b33b-2b2b38468e81 tempest-ServerActionsTestOtherA-1144166643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:34 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab Jun 24 00:18:34 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-6c05355c-5d4c-4ad2-b33b-2b2b38468e81 tempest-ServerActionsTestOtherA-1144166643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab" returned: 0 in 0.973s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-6c05355c-5d4c-4ad2-b33b-2b2b38468e81 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.997s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:35 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-6c05355c-5d4c-4ad2-b33b-2b2b38468e81 tempest-ServerActionsTestOtherA-1144166643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e8acacc-838b-40aa-93f0-0fcdb1450b38', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:18:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-8ea83061-7c94-4e9f-b6fd-8bcd6ef5450b req-6c05355c-5d4c-4ad2-b33b-2b2b38468e81 tempest-ServerActionsTestOtherA-1144166643 None] attachment_update completed successfully. Jun 24 00:18:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Acquiring lock "cinder-cb1b3502-ae07-47f4-87d6-38ea272edf48-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "cinder-cb1b3502-ae07-47f4-87d6-38ea272edf48-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Acquiring lock "cinder-quobyte-cb1b3502-ae07-47f4-87d6-38ea272edf48" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "cinder-quobyte-cb1b3502-ae07-47f4-87d6-38ea272edf48" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[225f1215-faba-4d3b-8366-c8277352b80f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:18:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:37 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 Jun 24 00:18:37 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:37 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48" returned: 0 in 0.826s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:37 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48 Jun 24 00:18:37 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:38 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cb1b3502-ae07-47f4-87d6-38ea272edf48" returned: 0 in 0.739s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "cinder-quobyte-cb1b3502-ae07-47f4-87d6-38ea272edf48" released by "delete_volume" :: held 1.638s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Created reservations ['edcc37d4-05a9-4b35-bbb1-7a36c80f071f', 'c5577e45-6830-4cc0-a84f-c7ccf54e8222', '3be4dff1-b119-4f3b-a5f3-c57953635827', '1e2e400c-12f3-4707-8ff4-d277b5f4eb78'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:38 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:18:38 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:39 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.722s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:18:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Deleted volume successfully. Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f08a3eb3-8989-44a9-84b2-ced87cee077f tempest-VolumeQuotasNegativeTestJSON-136224940 None] Lock "cinder-cb1b3502-ae07-47f4-87d6-38ea272edf48-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:39 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:18:39 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:40 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.126s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:18:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:18:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 8 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:18:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:18:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Acquiring lock "cinder-954bdf18-d622-4ade-a996-bb4c07a6a949-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "cinder-954bdf18-d622-4ade-a996-bb4c07a6a949-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Acquiring lock "cinder-quobyte-954bdf18-d622-4ade-a996-bb4c07a6a949" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "cinder-quobyte-954bdf18-d622-4ade-a996-bb4c07a6a949" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf84de71-6a8d-427a-bbf8-8c3acbd75420]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:18:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:43 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 Jun 24 00:18:43 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:45 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949" returned: 0 in 1.540s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:45 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949 Jun 24 00:18:45 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:47 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-954bdf18-d622-4ade-a996-bb4c07a6a949" returned: 0 in 2.000s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "cinder-quobyte-954bdf18-d622-4ade-a996-bb4c07a6a949" released by "delete_volume" :: held 3.634s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Created reservations ['c7f643d5-4a16-40d3-b70b-0fecd4891f27', '297a9c40-d9dc-47ca-87aa-f2786bd34c27', 'cba85093-d203-467c-9779-bf6f689c4f5b', '379428e2-8d13-4af1-8972-73987b16e4b9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:47 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:18:47 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:49 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.567s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:18:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Deleted volume successfully. Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-338971c3-4112-4978-964d-bd5cc1d5b8a4 tempest-TaggedAttachmentsTest-1798809105 None] Lock "cinder-954bdf18-d622-4ade-a996-bb4c07a6a949-delete_volume" released by "delete_volume" :: held 5.549s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Flow 'volume_create_manager' (120fd1d7-d4bd-448e-bda6-cd2f1a9d89f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfa09e5-ab3e-49f0-a09c-b6357c1f74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfa09e5-ab3e-49f0-a09c-b6357c1f74e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1706120711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0828939-0771-4314-96bc-4e1e5130482b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f647f68719264141b1086ff24dc333d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:49Z,use_quota=True,user_id='fae164e179e24baf90ce2538148760cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8ccb8a7-a1de-4e4b-83ff-4b3bce1eedfd),volume_type_id=b8ccb8a7-a1de-4e4b-83ff-4b3bce1eedfd)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d42d68-2dc2-4cf4-85bd-d38f23d6554a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d42d68-2dc2-4cf4-85bd-d38f23d6554a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becccb6e-031a-4bb7-be33-5dcff15a442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becccb6e-031a-4bb7-be33-5dcff15a442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0828939-0771-4314-96bc-4e1e5130482b', 'volume_name': 'volume-f0828939-0771-4314-96bc-4e1e5130482b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b55b74a-886a-4029-9d58-c75dabc04e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b55b74a-886a-4029-9d58-c75dabc04e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f6ca65-c697-400c-bb68-d9810b5e72fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Volume f0828939-0771-4314-96bc-4e1e5130482b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0828939-0771-4314-96bc-4e1e5130482b', 'volume_size': 1} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1706120711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0828939-0771-4314-96bc-4e1e5130482b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f647f68719264141b1086ff24dc333d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:18:49Z,use_quota=True,user_id='fae164e179e24baf90ce2538148760cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8ccb8a7-a1de-4e4b-83ff-4b3bce1eedfd),volume_type_id=b8ccb8a7-a1de-4e4b-83ff-4b3bce1eedfd)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Creating volume f0828939-0771-4314-96bc-4e1e5130482b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:18:49 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:18:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:49 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b 1073741824 Jun 24 00:18:49 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:50 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b 1073741824" returned: 0 in 1.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:50 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b Jun 24 00:18:50 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:51 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b" returned: 0 in 0.755s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:18:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f6ca65-c697-400c-bb68-d9810b5e72fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0828939-0771-4314-96bc-4e1e5130482b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e315ff-bf20-47d0-8cbf-fdd6a6a0e3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:18:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Volume volume-f0828939-0771-4314-96bc-4e1e5130482b (f0828939-0771-4314-96bc-4e1e5130482b): created successfully Jun 24 00:18:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e315ff-bf20-47d0-8cbf-fdd6a6a0e3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:18:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Flow 'volume_create_manager' (120fd1d7-d4bd-448e-bda6-cd2f1a9d89f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:18:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ec2f0cef-7d1a-4de5-a54c-20aaf8b3e087 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Created volume successfully. Jun 24 00:18:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:53 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:18:53 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:54 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.124s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:18:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-21756df0-5362-406b-a957-72690e6917a8 tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Retype volume completed successfully. Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Acquiring lock "cinder-f0828939-0771-4314-96bc-4e1e5130482b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "cinder-f0828939-0771-4314-96bc-4e1e5130482b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=62,cinder:SELECT=44,cinder:DELETE=5,cinder:INSERT=9 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=60,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=4 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Acquiring lock "cinder-quobyte-f0828939-0771-4314-96bc-4e1e5130482b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "cinder-quobyte-f0828939-0771-4314-96bc-4e1e5130482b" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74a5e7-b7bd-48b9-915d-e5c3e8ca6da3]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:18:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:55 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b Jun 24 00:18:55 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:56 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b" returned: 0 in 1.161s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:56 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b Jun 24 00:18:56 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:56 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f0828939-0771-4314-96bc-4e1e5130482b" returned: 0 in 0.815s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "cinder-quobyte-f0828939-0771-4314-96bc-4e1e5130482b" released by "delete_volume" :: held 2.040s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:18:57 devstack cinder-volume[94472]: WARNING cinder.quota [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:18:57 devstack cinder-volume[94472]: WARNING cinder.quota [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:18:57 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Created reservations ['bd07afe0-7470-4071-8c0f-b07c37f720a1', 'ba7c46b1-dd6c-4255-8ca7-be3a6abf7bb4', 'd17b59bd-a8bc-40cc-9c70-576b1dc777fa', 'db2b4241-91e3-4a54-a506-c65324ce5e9f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:18:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:18:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:18:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:18:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:18:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:18:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:18:57 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:18:57 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:18:58 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jun 24 00:18:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.246s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:18:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:18:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Deleted volume successfully. Jun 24 00:18:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-391bc83b-e1d4-481b-aca5-de223e7792fd tempest-VolumeRetypeWithoutMigrationTest-1593822613 None] Lock "cinder-f0828939-0771-4314-96bc-4e1e5130482b-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Flow 'volume_create_manager' (7e4ab569-9037-4ff2-a910-5feb3f4c532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7c9c17-dc8d-4d54-b391-1d86f36b5cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7c9c17-dc8d-4d54-b391-1d86f36b5cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1228552054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c5fedc-56d4-4881-91c1-f3db5e990766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26879bcafbae4ed89038fdb2b0c408f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:06Z,use_quota=True,user_id='f53da80b4df14c1eaecfda7129674172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cabed7-1b4d-46e1-9fd3-c41ce41a09d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cabed7-1b4d-46e1-9fd3-c41ce41a09d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77d5ee5-a834-4338-8e9c-48d449560455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77d5ee5-a834-4338-8e9c-48d449560455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c5fedc-56d4-4881-91c1-f3db5e990766', 'volume_name': 'volume-43c5fedc-56d4-4881-91c1-f3db5e990766', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f94b9e4-cf29-4409-b2b0-40ed66367567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f94b9e4-cf29-4409-b2b0-40ed66367567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc71e65f-3b91-44b9-9090-870072ac3324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Volume 43c5fedc-56d4-4881-91c1-f3db5e990766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c5fedc-56d4-4881-91c1-f3db5e990766', 'volume_size': 1} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1228552054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c5fedc-56d4-4881-91c1-f3db5e990766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26879bcafbae4ed89038fdb2b0c408f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:06Z,use_quota=True,user_id='f53da80b4df14c1eaecfda7129674172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Creating volume 43c5fedc-56d4-4881-91c1-f3db5e990766 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:19:06 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:06 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 1073741824 Jun 24 00:19:06 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:06 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 1073741824" returned: 0 in 0.894s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:06 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 Jun 24 00:19:06 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:07 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766" returned: 0 in 0.730s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:19:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc71e65f-3b91-44b9-9090-870072ac3324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c5fedc-56d4-4881-91c1-f3db5e990766', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611e656b-9ef3-443b-a66d-94daa12f6733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:07 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Volume volume-43c5fedc-56d4-4881-91c1-f3db5e990766 (43c5fedc-56d4-4881-91c1-f3db5e990766): created successfully Jun 24 00:19:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611e656b-9ef3-443b-a66d-94daa12f6733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Flow 'volume_create_manager' (7e4ab569-9037-4ff2-a910-5feb3f4c532a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:19:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-513ccedd-70cc-43a9-98a0-bec77fa3890d tempest-VolumesServicesTestJSON-504550642 None] Created volume successfully. Jun 24 00:19:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Acquiring lock "cinder-43c5fedc-56d4-4881-91c1-f3db5e990766-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Lock "cinder-43c5fedc-56d4-4881-91c1-f3db5e990766-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Acquiring lock "cinder-quobyte-43c5fedc-56d4-4881-91c1-f3db5e990766" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Lock "cinder-quobyte-43c5fedc-56d4-4881-91c1-f3db5e990766" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6528b1ef-2c36-49f3-8317-3d84eb593584]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:19:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:08 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 Jun 24 00:19:08 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:09 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766" returned: 0 in 1.210s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:09 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766 Jun 24 00:19:09 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:10 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43c5fedc-56d4-4881-91c1-f3db5e990766" returned: 0 in 0.803s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Lock "cinder-quobyte-43c5fedc-56d4-4881-91c1-f3db5e990766" released by "delete_volume" :: held 2.075s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Created reservations ['54bab008-8160-43b7-99a6-3499b86fe35f', '6a7f4a10-1f98-40ee-a735-89534803379c', '0d2762dd-a320-4304-b5e4-18fab332d13a', '68ed7b25-08a7-45e7-b601-b96bfbd0a090'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:10 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:19:10 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:11 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.697s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:11 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:19:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Deleted volume successfully. Jun 24 00:19:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-649ff3de-85c8-4b9a-b375-53c0d3e2fb64 tempest-VolumesServicesTestJSON-504550642 None] Lock "cinder-43c5fedc-56d4-4881-91c1-f3db5e990766-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-407a2b1c-275d-4840-a52f-a8117111cece req-30f771d7-d237-4dc4-bdcd-1f97b7151ec9 tempest-ServerActionsTestOtherA-1144166643 None] Terminate volume connection completed successfully. Jun 24 00:19:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-407a2b1c-275d-4840-a52f-a8117111cece req-30f771d7-d237-4dc4-bdcd-1f97b7151ec9 tempest-ServerActionsTestOtherA-1144166643 None] Deleting attachment 2e8acacc-838b-40aa-93f0-0fcdb1450b38. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Flow 'volume_create_manager' (5cad3bc9-188f-4536-b375-72d82f7ae934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe302a6-02c1-4a1d-b543-35ec1cec5d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe302a6-02c1-4a1d-b543-35ec1cec5d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1883808288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a11a3f9-0b36-4752-b4b6-6b3c85620312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053064a26a04fafb6891b1965d3edf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:19Z,use_quota=True,user_id='f2f0b734f72e4b83887f372ab955bc4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1ca4b9f-5dcd-4179-888e-bb18fc7f3280),volume_type_id=d1ca4b9f-5dcd-4179-888e-bb18fc7f3280)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c1aff0-3a91-4585-87fa-345c577773a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c1aff0-3a91-4585-87fa-345c577773a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e1cbb8-cbcc-4b96-b415-d99b2d9ab1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e1cbb8-cbcc-4b96-b415-d99b2d9ab1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a11a3f9-0b36-4752-b4b6-6b3c85620312', 'volume_name': 'volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15726bef-b5d5-4d8d-89c9-290173ceaee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15726bef-b5d5-4d8d-89c9-290173ceaee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf417733-b31d-4ad5-9582-6832d18d1b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Volume 9a11a3f9-0b36-4752-b4b6-6b3c85620312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312', 'volume_size': 1} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1883808288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a11a3f9-0b36-4752-b4b6-6b3c85620312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3053064a26a04fafb6891b1965d3edf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:19Z,use_quota=True,user_id='f2f0b734f72e4b83887f372ab955bc4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1ca4b9f-5dcd-4179-888e-bb18fc7f3280),volume_type_id=d1ca4b9f-5dcd-4179-888e-bb18fc7f3280)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Creating volume 9a11a3f9-0b36-4752-b4b6-6b3c85620312 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:19:18 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:19:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:18 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 1073741824 Jun 24 00:19:18 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:19 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 1073741824" returned: 0 in 0.827s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:19 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 Jun 24 00:19:19 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:20 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312" returned: 0 in 0.690s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf417733-b31d-4ad5-9582-6832d18d1b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d6aad1-9a7a-4e9a-986e-fb2eb4ab44c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Volume volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 (9a11a3f9-0b36-4752-b4b6-6b3c85620312): created successfully Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d6aad1-9a7a-4e9a-986e-fb2eb4ab44c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Flow 'volume_create_manager' (5cad3bc9-188f-4536-b375-72d82f7ae934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:19:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f7a72858-6e6f-4857-a4e2-ace1516716b8 tempest-VolumeTypesAccessTest-775248384 None] Created volume successfully. Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Acquiring lock "cinder-9a11a3f9-0b36-4752-b4b6-6b3c85620312-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Lock "cinder-9a11a3f9-0b36-4752-b4b6-6b3c85620312-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Acquiring lock "cinder-quobyte-9a11a3f9-0b36-4752-b4b6-6b3c85620312" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Lock "cinder-quobyte-9a11a3f9-0b36-4752-b4b6-6b3c85620312" acquired by "delete_volume" :: waited 0.054s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a360af22-f59d-41d7-b8c0-6f8687649cff]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:19:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:21 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 Jun 24 00:19:21 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:21 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312" returned: 0 in 0.856s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:22 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312 Jun 24 00:19:22 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:22 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9a11a3f9-0b36-4752-b4b6-6b3c85620312" returned: 0 in 0.917s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Lock "cinder-quobyte-9a11a3f9-0b36-4752-b4b6-6b3c85620312" released by "delete_volume" :: held 1.838s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:22 devstack cinder-volume[94472]: WARNING cinder.quota [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-478782056 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-478782056, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:19:22 devstack cinder-volume[94472]: WARNING cinder.quota [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-478782056 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-478782056, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:19:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Created reservations ['b1add9ec-af46-4419-9c22-3ef0d159f4c7', 'b51edaee-3694-40ff-b5dc-1094dbfa90eb', 'ee2c03f1-f004-4f79-8aa3-70de6fe9128d', '345ce2c5-49af-4d5d-9c9c-51df32c4dbe3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Acquiring lock "cinder-ef6c5a45-a262-4297-8d95-3b77fb1213ab-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:23 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:19:23 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Lock "cinder-ef6c5a45-a262-4297-8d95-3b77fb1213ab-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Acquiring lock "cinder-quobyte-ef6c5a45-a262-4297-8d95-3b77fb1213ab" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Lock "cinder-quobyte-ef6c5a45-a262-4297-8d95-3b77fb1213ab" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b229852-4a26-42cf-831d-d27e214ac93c]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:23 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab Jun 24 00:19:23 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:23 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.796s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:19:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Deleted volume successfully. Jun 24 00:19:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0144927e-3b20-41b7-8ed4-2ca31e93e091 tempest-VolumeTypesAccessTest-775248384 None] Lock "cinder-9a11a3f9-0b36-4752-b4b6-6b3c85620312-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:24 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab" returned: 0 in 0.907s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:24 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab Jun 24 00:19:24 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:24 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ef6c5a45-a262-4297-8d95-3b77fb1213ab" returned: 0 in 0.804s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Lock "cinder-quobyte-ef6c5a45-a262-4297-8d95-3b77fb1213ab" released by "delete_volume" :: held 1.768s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Created reservations ['01ff2636-10b1-4a32-926c-4a4c13133d82', '98f20aa2-798d-4f00-9aad-2a7bc2f69843', '7aa184cf-a748-4fbe-be12-587a8686b5ef', '2f408cd8-7285-438a-92dd-6fabb11fa804'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:25 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:19:25 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:25 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.815s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:25 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:19:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Deleted volume successfully. Jun 24 00:19:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7065c659-c7a2-4fce-9c0b-4b4e20a098d0 tempest-ServerActionsTestOtherA-1144166643 None] Lock "cinder-ef6c5a45-a262-4297-8d95-3b77fb1213ab-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:35 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:19:36 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:19:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Acquiring lock "cinder-4087ebbb-8417-4eeb-bc07-9adba315efc5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "cinder-4087ebbb-8417-4eeb-bc07-9adba315efc5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Acquiring lock "cinder-quobyte-4087ebbb-8417-4eeb-bc07-9adba315efc5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "cinder-quobyte-4087ebbb-8417-4eeb-bc07-9adba315efc5" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67a0bd2-0a13-48de-adbb-1ce8898beaf3]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:19:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:37 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 Jun 24 00:19:37 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:38 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5" returned: 0 in 1.078s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:38 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5 Jun 24 00:19:38 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:39 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:19:39 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:39 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4087ebbb-8417-4eeb-bc07-9adba315efc5" returned: 0 in 1.399s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "cinder-quobyte-4087ebbb-8417-4eeb-bc07-9adba315efc5" released by "delete_volume" :: held 2.558s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Created reservations ['dbc8533b-6c13-4581-bb46-66dc89864247', 'fef9571f-f33d-4740-ac37-ebd66b80d519', '2e01c1a6-e75d-42b8-a647-2ad4766381a7', '1a93c942-d440-4992-8754-b702f9f478c6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:40 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:19:40 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:40 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.064s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:19:41 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.528s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:41 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:19:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Deleted volume successfully. Jun 24 00:19:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9df73a56-3f74-436b-83b4-025ebf8f1ebc tempest-AttachVolumeShelveTestJSON-1540736578 None] Lock "cinder-4087ebbb-8417-4eeb-bc07-9adba315efc5-delete_volume" released by "delete_volume" :: held 4.554s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Flow 'volume_create_manager' (a0c92204-87f7-4029-ac25-18b4ad7b4e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3009054-4af2-4e05-aaff-1aa62624d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3009054-4af2-4e05-aaff-1aa62624d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1336259406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc28b4c2-56e6-4e09-9854-9f848d7bfa0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a7375de3b0d4e46be5f36c0aa7567f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:47Z,use_quota=True,user_id='6dbcb9d573d94acb835fd97d000b9433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76d7d50-e497-4eaf-8651-9e4f59be960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76d7d50-e497-4eaf-8651-9e4f59be960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d001d2c-f293-43dc-b16a-af87f7b5c151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d001d2c-f293-43dc-b16a-af87f7b5c151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc28b4c2-56e6-4e09-9854-9f848d7bfa0e', 'volume_name': 'volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb54bc65-bc05-4ccb-9567-ab7c2f0a0800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb54bc65-bc05-4ccb-9567-ab7c2f0a0800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656337d7-bb2a-4d4d-9176-d62976587dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:46 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Volume bc28b4c2-56e6-4e09-9854-9f848d7bfa0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e', 'volume_size': 1} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1336259406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc28b4c2-56e6-4e09-9854-9f848d7bfa0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a7375de3b0d4e46be5f36c0aa7567f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:47Z,use_quota=True,user_id='6dbcb9d573d94acb835fd97d000b9433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Creating volume bc28b4c2-56e6-4e09-9854-9f848d7bfa0e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:19:46 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:19:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:46 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e 1073741824 Jun 24 00:19:46 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:47 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e 1073741824" returned: 0 in 1.141s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:48 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e Jun 24 00:19:48 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:48 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e" returned: 0 in 0.820s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:19:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656337d7-bb2a-4d4d-9176-d62976587dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71596c28-d407-4fb5-83a3-7df0e9dd6ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:48 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Volume volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e (bc28b4c2-56e6-4e09-9854-9f848d7bfa0e): created successfully Jun 24 00:19:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71596c28-d407-4fb5-83a3-7df0e9dd6ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Flow 'volume_create_manager' (a0c92204-87f7-4029-ac25-18b4ad7b4e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:19:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-a4e8837e-e7de-4bcf-842f-73f5f2ee1adb req-6e7dc492-c1f3-48d2-af1d-822dfb21d704 tempest-VolumesGetTestJSON-808209644 None] Created volume successfully. Jun 24 00:19:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Acquiring lock "cinder-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Lock "cinder-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Acquiring lock "cinder-quobyte-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:19:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Lock "cinder-quobyte-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:19:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9250294d-0cf6-4aae-a5b7-4320f625342a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:19:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:50 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e Jun 24 00:19:50 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:51 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e" returned: 0 in 1.107s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:51 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e Jun 24 00:19:51 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:52 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e" returned: 0 in 0.758s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Lock "cinder-quobyte-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e" released by "delete_volume" :: held 1.949s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG cinder.quota [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Created reservations ['74482065-7069-40c6-acf5-e8b9cf946c39', 'ab12444a-0dea-4a4a-9724-0b807c5130ad', 'af3ee5da-0fdc-4730-b577-0f058c1f9b31', '1c714d82-f8df-4711-92b3-92a04ea71f1a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:52 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:19:52 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:53 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.000s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:53 devstack cinder-volume[94472]: DEBUG cinder.manager [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:19:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Deleted volume successfully. Jun 24 00:19:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-c2f280c7-772f-49d3-85dc-25e56bf36bb7 req-f822cff4-2172-4d9e-8349-83c46e572a9c tempest-VolumesGetTestJSON-808209644 None] Lock "cinder-bc28b4c2-56e6-4e09-9854-9f848d7bfa0e-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Flow 'volume_create_manager' (bcb238ec-75e1-4d5a-88fb-3907431b8376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4365b5-1449-4552-ae13-72d898a98c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4365b5-1449-4552-ae13-72d898a98c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-839056735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792f4e1c-0a15-47ee-ad7b-96ba5522ca9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afecb54e34204b3d8506a4e74bf34543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:57Z,use_quota=True,user_id='911b17f0c33044019ac0bba5fa8a5809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006a3af7-ff92-4580-b2c1-f7a68d5b91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006a3af7-ff92-4580-b2c1-f7a68d5b91e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef254151-0796-413f-baf2-a1dd72f74e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef254151-0796-413f-baf2-a1dd72f74e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792f4e1c-0a15-47ee-ad7b-96ba5522ca9f', 'volume_name': 'volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2f74dc-2886-4c5a-a90d-aa8d6bcfdf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2f74dc-2886-4c5a-a90d-aa8d6bcfdf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b002ef96-71e2-4f91-a5b0-749f81d6f364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Volume 792f4e1c-0a15-47ee-ad7b-96ba5522ca9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f', 'volume_size': 1} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-839056735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792f4e1c-0a15-47ee-ad7b-96ba5522ca9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afecb54e34204b3d8506a4e74bf34543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:57Z,use_quota=True,user_id='911b17f0c33044019ac0bba5fa8a5809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Creating volume 792f4e1c-0a15-47ee-ad7b-96ba5522ca9f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:19:57 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:19:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:57 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f 1073741824 Jun 24 00:19:57 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:59 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f 1073741824" returned: 0 in 1.614s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:19:59 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f Jun 24 00:19:59 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Flow 'volume_create_manager' (3efc3ba8-e45a-40c0-980a-ffa5c6d8aa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2a17d6-0e55-4c3a-be48-1ccb295e01fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2a17d6-0e55-4c3a-be48-1ccb295e01fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1685003811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a25625-0302-4c1d-a26b-40dbb7499d74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='840b0186bc3b4fbba4421f560f97010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:59Z,use_quota=True,user_id='d28462db51044aa283ba37dce1ae979d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e9592c-8d3c-4d2e-b2bd-7d872ecc22f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e9592c-8d3c-4d2e-b2bd-7d872ecc22f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a309894-ccbf-4e0f-8b97-8d6cb6808f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a309894-ccbf-4e0f-8b97-8d6cb6808f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a25625-0302-4c1d-a26b-40dbb7499d74', 'volume_name': 'volume-c7a25625-0302-4c1d-a26b-40dbb7499d74', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842e046a-d6b3-4a05-b924-790b1a4e3ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842e046a-d6b3-4a05-b924-790b1a4e3ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e0c08d-4216-4e1f-bad8-35e0d3445d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:19:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Volume c7a25625-0302-4c1d-a26b-40dbb7499d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a25625-0302-4c1d-a26b-40dbb7499d74', 'volume_size': 1} Jun 24 00:19:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:00 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f" returned: 0 in 1.261s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] <== create_volume: return (2991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.997s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.101s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1685003811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a25625-0302-4c1d-a26b-40dbb7499d74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='840b0186bc3b4fbba4421f560f97010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:19:59Z,use_quota=True,user_id='d28462db51044aa283ba37dce1ae979d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Creating volume c7a25625-0302-4c1d-a26b-40dbb7499d74 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:00 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b002ef96-71e2-4f91-a5b0-749f81d6f364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:00 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 1073741824 Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ac2336-4ed5-428e-870b-397974ac7490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:00 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Volume volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f (792f4e1c-0a15-47ee-ad7b-96ba5522ca9f): created successfully Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ac2336-4ed5-428e-870b-397974ac7490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Flow 'volume_create_manager' (bcb238ec-75e1-4d5a-88fb-3907431b8376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a9f16b2b-df05-4382-acce-b9c1f5310235 tempest-AbsoluteLimitsTests-810612947 None] Created volume successfully. Jun 24 00:20:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Acquiring lock "cinder-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Lock "cinder-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Acquiring lock "cinder-quobyte-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Lock "cinder-quobyte-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c773841d-5d3d-4064-bd8d-a347c0625310]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:02 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 1073741824" returned: 0 in 1.920s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:02 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f Jun 24 00:20:02 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:02 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 Jun 24 00:20:02 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:03 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f" returned: 0 in 1.362s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:03 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74" returned: 0 in 0.988s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] <== create_volume: return (3009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:03 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f Jun 24 00:20:03 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e0c08d-4216-4e1f-bad8-35e0d3445d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a25625-0302-4c1d-a26b-40dbb7499d74', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffab68f-c266-49dc-bb48-77b3c444d9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Volume volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 (c7a25625-0302-4c1d-a26b-40dbb7499d74): created successfully Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffab68f-c266-49dc-bb48-77b3c444d9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Flow 'volume_create_manager' (3efc3ba8-e45a-40c0-980a-ffa5c6d8aa83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cf646283-94df-47da-aee2-ee024c0b7538 tempest-VolumesTestJSON-565548391 None] Created volume successfully. Jun 24 00:20:04 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f" returned: 0 in 0.920s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Lock "cinder-quobyte-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f" released by "delete_volume" :: held 2.357s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Created reservations ['9bb9c36c-f823-423e-b460-d7cdc603d9c9', 'cba8b4af-42da-4b1a-8d29-14efe489a8c0', '82e303e3-63f2-40c0-b5d6-182a989798de', '6a3cae30-7b3e-49a2-aac9-54d40c393aa2'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:04 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:04 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:05 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.857s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Deleted volume successfully. Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d25a81f-a62f-429c-9877-76f40ec70c64 tempest-AbsoluteLimitsTests-810612947 None] Lock "cinder-792f4e1c-0a15-47ee-ad7b-96ba5522ca9f-delete_volume" released by "delete_volume" :: held 3.562s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Flow 'volume_create_manager' (58cc8110-75a6-44b6-a3a8-b0c47db8b9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5dd601-c288-4b02-9b5e-f0c0f1080fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5dd601-c288-4b02-9b5e-f0c0f1080fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1893813726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a63405-a5d0-4da2-8f50-aaef46e577c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='840b0186bc3b4fbba4421f560f97010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:06Z,use_quota=True,user_id='d28462db51044aa283ba37dce1ae979d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d66d77-7438-47af-8a4b-7344a469df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d66d77-7438-47af-8a4b-7344a469df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66886ed-a689-4324-809b-71c442ac5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66886ed-a689-4324-809b-71c442ac5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a63405-a5d0-4da2-8f50-aaef46e577c9', 'volume_name': 'volume-02a63405-a5d0-4da2-8f50-aaef46e577c9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9931f2bf-1ee5-4494-a891-6455b36712ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9931f2bf-1ee5-4494-a891-6455b36712ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58efbc38-dc5f-4840-a71e-c9987e717075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Volume 02a63405-a5d0-4da2-8f50-aaef46e577c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a63405-a5d0-4da2-8f50-aaef46e577c9', 'volume_size': 1} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1893813726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a63405-a5d0-4da2-8f50-aaef46e577c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='840b0186bc3b4fbba4421f560f97010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:06Z,use_quota=True,user_id='d28462db51044aa283ba37dce1ae979d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Creating volume 02a63405-a5d0-4da2-8f50-aaef46e577c9 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:05 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:05 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 1073741824 Jun 24 00:20:05 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:07 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 1073741824" returned: 0 in 1.193s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:07 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 Jun 24 00:20:07 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:07 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9" returned: 0 in 0.812s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58efbc38-dc5f-4840-a71e-c9987e717075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a63405-a5d0-4da2-8f50-aaef46e577c9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad696867-282c-4787-b058-fbc0497d5728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Volume volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 (02a63405-a5d0-4da2-8f50-aaef46e577c9): created successfully Jun 24 00:20:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad696867-282c-4787-b058-fbc0497d5728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Flow 'volume_create_manager' (58cc8110-75a6-44b6-a3a8-b0c47db8b9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b23fc734-2339-4f5d-b8d9-53d464706351 tempest-VolumesTestJSON-565548391 None] Created volume successfully. Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Flow 'volume_create_manager' (3b50da15-d435-4c5b-8b50-63868cb30251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defefd30-d3f4-462a-b693-86cc07b90a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defefd30-d3f4-462a-b693-86cc07b90a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1459357888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242d8d73-ce72-4cc4-b89f-dbdcace78859,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='840b0186bc3b4fbba4421f560f97010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:10Z,use_quota=True,user_id='d28462db51044aa283ba37dce1ae979d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f12916-eb3e-40dd-b5d7-bfa5df0b0887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f12916-eb3e-40dd-b5d7-bfa5df0b0887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66dc4c14-8842-445d-98f6-2d2c24a049b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66dc4c14-8842-445d-98f6-2d2c24a049b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242d8d73-ce72-4cc4-b89f-dbdcace78859', 'volume_name': 'volume-242d8d73-ce72-4cc4-b89f-dbdcace78859', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c0db6a-9478-43ce-8d8c-d7e8ebd713e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c0db6a-9478-43ce-8d8c-d7e8ebd713e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063d4d4f-28ff-4e6b-881a-6deb225cdbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Volume 242d8d73-ce72-4cc4-b89f-dbdcace78859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242d8d73-ce72-4cc4-b89f-dbdcace78859', 'volume_size': 1} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1459357888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242d8d73-ce72-4cc4-b89f-dbdcace78859,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='840b0186bc3b4fbba4421f560f97010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:10Z,use_quota=True,user_id='d28462db51044aa283ba37dce1ae979d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Creating volume 242d8d73-ce72-4cc4-b89f-dbdcace78859 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:09 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 1073741824 Jun 24 00:20:09 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:10 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 1073741824" returned: 0 in 0.975s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:10 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 Jun 24 00:20:10 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:11 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859" returned: 0 in 0.816s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063d4d4f-28ff-4e6b-881a-6deb225cdbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242d8d73-ce72-4cc4-b89f-dbdcace78859', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98510780-f8e1-4183-b850-57ba860d3a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Volume volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 (242d8d73-ce72-4cc4-b89f-dbdcace78859): created successfully Jun 24 00:20:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98510780-f8e1-4183-b850-57ba860d3a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Flow 'volume_create_manager' (3b50da15-d435-4c5b-8b50-63868cb30251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e8da2866-06f4-46c0-ad74-8b29cd385dda tempest-VolumesTestJSON-565548391 None] Created volume successfully. Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Flow 'volume_create_manager' (44b318d7-3761-4afd-b169-2d7091c1060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ce5f6b-1a1a-4ea3-81a1-b1eb2157b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ce5f6b-1a1a-4ea3-81a1-b1eb2157b411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1565940040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ec45c0-633d-4f24-875b-3d5975f4fc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b824f161ac9460f8982b5252f982fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:12Z,use_quota=True,user_id='82d4107ad83f4b848687e59add859afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e011eb2-bb21-40fd-9855-65c130eb0b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e011eb2-bb21-40fd-9855-65c130eb0b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfd828f-cf0d-49df-9eca-2c64533b07f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Flow 'volume_create_manager' (3fc47c2c-ca47-46ef-ba3d-be1c6c8e269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59afef51-ed89-4a2f-a6f7-c970434ae7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfd828f-cf0d-49df-9eca-2c64533b07f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '72ec45c0-633d-4f24-875b-3d5975f4fc15', 'volume_name': 'volume-72ec45c0-633d-4f24-875b-3d5975f4fc15', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d65f12-abf0-426e-b035-51c1483bf51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d65f12-abf0-426e-b035-51c1483bf51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24b8138-ef31-4003-b7b6-4f6e31bf9c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Volume 72ec45c0-633d-4f24-875b-3d5975f4fc15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-72ec45c0-633d-4f24-875b-3d5975f4fc15', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Trying to clone 72ec45c0-633d-4f24-875b-3d5975f4fc15 from image f57f6d67-fa39-4fca-b804-ab80f4171967 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59afef51-ed89-4a2f-a6f7-c970434ae7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1281598944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31546a0-f436-46a8-bdac-8c62b8a99176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8248f612a404e1890457aa4aa55e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:12Z,use_quota=True,user_id='7a6a56ba2d9442549ed8179fb7659106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8272d9-d13e-4147-b955-7800a4cfa1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8272d9-d13e-4147-b955-7800a4cfa1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e72ff3-2764-4a00-b229-4ebb02fa0c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e72ff3-2764-4a00-b229-4ebb02fa0c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31546a0-f436-46a8-bdac-8c62b8a99176', 'volume_name': 'volume-f31546a0-f436-46a8-bdac-8c62b8a99176', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae326d6-34ac-4e97-a89b-73e9b39aa806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae326d6-34ac-4e97-a89b-73e9b39aa806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd3fd4d-215e-4084-8056-58fe80af4589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Volume f31546a0-f436-46a8-bdac-8c62b8a99176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31546a0-f436-46a8-bdac-8c62b8a99176', 'volume_size': 1} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1281598944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31546a0-f436-46a8-bdac-8c62b8a99176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8248f612a404e1890457aa4aa55e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:12Z,use_quota=True,user_id='7a6a56ba2d9442549ed8179fb7659106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Creating volume f31546a0-f436-46a8-bdac-8c62b8a99176 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:12 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 1073741824 Jun 24 00:20:12 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:13 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:20:13 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Image download 20.69 MB at 20.69 MB/s Jun 24 00:20:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaea8de-263d-43fa-bcba-cdef0cffa85f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:13 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD Jun 24 00:20:13 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:13 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 1073741824" returned: 0 in 1.063s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:13 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 Jun 24 00:20:13 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:13 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:13 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Temporary image f57f6d67-fa39-4fca-b804-ab80f4171967 is fetched for user 82d4107ad83f4b848687e59add859afc. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Acquiring lock "cinder-242d8d73-ce72-4cc4-b89f-dbdcace78859-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Lock "cinder-242d8d73-ce72-4cc4-b89f-dbdcace78859-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Acquiring lock "cinder-quobyte-242d8d73-ce72-4cc4-b89f-dbdcace78859" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d8ffcf-76b3-4733-a972-26fffe85e5e1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Lock "cinder-quobyte-242d8d73-ce72-4cc4-b89f-dbdcace78859" acquired by "delete_volume" :: waited 0.044s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb27328-55be-4773-ae3a-dfb81c275d31]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:14 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD Jun 24 00:20:14 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:14 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 Jun 24 00:20:14 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:14 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176" returned: 0 in 0.747s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd3fd4d-215e-4084-8056-58fe80af4589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31546a0-f436-46a8-bdac-8c62b8a99176', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5add05-aeec-4ab5-a3f5-2bd25db5e597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Volume volume-f31546a0-f436-46a8-bdac-8c62b8a99176 (f31546a0-f436-46a8-bdac-8c62b8a99176): created successfully Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5add05-aeec-4ab5-a3f5-2bd25db5e597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Flow 'volume_create_manager' (3fc47c2c-ca47-46ef-ba3d-be1c6c8e269d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a736b500-1438-453a-94eb-45d71dabe285 tempest-ServersNegativeTestJSON-1798589168 None] Created volume successfully. Jun 24 00:20:14 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859" returned: 0 in 0.779s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:14 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1565940040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ec45c0-633d-4f24-875b-3d5975f4fc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b824f161ac9460f8982b5252f982fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:12Z,use_quota=True,user_id='82d4107ad83f4b848687e59add859afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Creating volume 72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:15 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859 Jun 24 00:20:15 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:15 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:15 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 1073741824 Jun 24 00:20:15 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:15 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-242d8d73-ce72-4cc4-b89f-dbdcace78859" returned: 0 in 0.672s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Lock "cinder-quobyte-242d8d73-ce72-4cc4-b89f-dbdcace78859" released by "delete_volume" :: held 1.499s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Created reservations ['fd4248f3-2f9f-4017-8d55-b46c55881497', '75df6750-f389-4049-9238-969f26118224', '8ab3a366-2f1a-445a-84be-7699341a3f2d', '38446656-5246-42e3-9735-a002736804f2'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:15 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:15 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:15 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 1073741824" returned: 0 in 0.913s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:15 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:15 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Acquiring lock "cinder-02a63405-a5d0-4da2-8f50-aaef46e577c9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Lock "cinder-02a63405-a5d0-4da2-8f50-aaef46e577c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Acquiring lock "cinder-quobyte-02a63405-a5d0-4da2-8f50-aaef46e577c9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Lock "cinder-quobyte-02a63405-a5d0-4da2-8f50-aaef46e577c9" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e073358-4d52-4b1c-b073-f0a42164ead0]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:16 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 Jun 24 00:20:16 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:16 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.088s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Deleted volume successfully. Jun 24 00:20:16 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 0 in 1.018s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eb07e01a-6ddf-4118-9539-3732e9c3add0 tempest-VolumesTestJSON-565548391 None] Lock "cinder-242d8d73-ce72-4cc4-b89f-dbdcace78859-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:17 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Attempting download of f57f6d67-fa39-4fca-b804-ab80f4171967 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}])) to volume 72ec45c0-633d-4f24-875b-3d5975f4fc15. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:20:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a88da2d-28b0-4267-b0ad-c0869130896e]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_rqkemypf {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:17 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_rqkemypf Jun 24 00:20:17 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:17 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9" returned: 0 in 1.231s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:17 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9 Jun 24 00:20:17 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:17 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Flow 'volume_create_manager' (1e87204b-a282-49d7-9b80-b2c3adbc7ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307cd00e-c587-41d8-b6fb-ff7537cbf3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307cd00e-c587-41d8-b6fb-ff7537cbf3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-498439468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3aba5b-2428-440a-bf88-2d05090e5a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8248f612a404e1890457aa4aa55e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:18Z,use_quota=True,user_id='7a6a56ba2d9442549ed8179fb7659106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610442e7-27d4-404f-b218-ac958e33c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610442e7-27d4-404f-b218-ac958e33c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5936af-4c26-4612-ba78-163928c7945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5936af-4c26-4612-ba78-163928c7945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3aba5b-2428-440a-bf88-2d05090e5a13', 'volume_name': 'volume-da3aba5b-2428-440a-bf88-2d05090e5a13', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bc5040-34b4-46f3-a1cf-db11d0fe8622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bc5040-34b4-46f3-a1cf-db11d0fe8622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae96d93a-e670-44c6-9f96-3b7035d3abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Volume da3aba5b-2428-440a-bf88-2d05090e5a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3aba5b-2428-440a-bf88-2d05090e5a13', 'volume_size': 1} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-498439468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3aba5b-2428-440a-bf88-2d05090e5a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8248f612a404e1890457aa4aa55e674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:18Z,use_quota=True,user_id='7a6a56ba2d9442549ed8179fb7659106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Creating volume da3aba5b-2428-440a-bf88-2d05090e5a13 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:18 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:18 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 1073741824 Jun 24 00:20:18 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:18 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_rqkemypf" returned: 0 in 1.227s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_rqkemypf {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:18 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_rqkemypf Jun 24 00:20:18 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:18 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-02a63405-a5d0-4da2-8f50-aaef46e577c9" returned: 0 in 1.084s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Lock "cinder-quobyte-02a63405-a5d0-4da2-8f50-aaef46e577c9" released by "delete_volume" :: held 2.399s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:18 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Created reservations ['7866a578-65f9-47a5-8eb3-2835802fd31a', '79c39f21-5720-45ee-8886-34a55cc22c4f', 'a329e6a9-57af-4c87-bb9e-e58b13363358', '801bfd0b-0863-4b28-b350-6d92b7c1b95e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:19 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:19 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:19 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 1073741824" returned: 0 in 1.209s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:19 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 Jun 24 00:20:19 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:19 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_rqkemypf" returned: 1 in 1.258s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_rqkemypf' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64731c5-4acb-45e5-8077-ccc20ae6fcb7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:19 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD Jun 24 00:20:19 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Acquiring lock "cinder-c7a25625-0302-4c1d-a26b-40dbb7499d74-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Lock "cinder-c7a25625-0302-4c1d-a26b-40dbb7499d74-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Acquiring lock "cinder-quobyte-c7a25625-0302-4c1d-a26b-40dbb7499d74" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Lock "cinder-quobyte-c7a25625-0302-4c1d-a26b-40dbb7499d74" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c514761-4e58-4a14-8c1b-c8c39dc8869d]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:20 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 Jun 24 00:20:20 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:20 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:20 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.162s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13" returned: 0 in 0.898s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Deleted volume successfully. Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae96d93a-e670-44c6-9f96-3b7035d3abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3aba5b-2428-440a-bf88-2d05090e5a13', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d550bc36-fd89-4b66-b471-26a0bc71d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Volume volume-da3aba5b-2428-440a-bf88-2d05090e5a13 (da3aba5b-2428-440a-bf88-2d05090e5a13): created successfully Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d550bc36-fd89-4b66-b471-26a0bc71d656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Flow 'volume_create_manager' (1e87204b-a282-49d7-9b80-b2c3adbc7ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ab4a29f-7c2b-4c45-b48e-e4e5c670bf9d tempest-VolumesTestJSON-565548391 None] Lock "cinder-02a63405-a5d0-4da2-8f50-aaef46e577c9-delete_volume" released by "delete_volume" :: held 3.970s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ff7408d0-0d80-4934-9939-5a415f30e5c1 tempest-ServersNegativeTestJSON-1798589168 None] Created volume successfully. Jun 24 00:20:20 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD" returned: 0 in 0.887s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] f57f6d67-fa39-4fca-b804-ab80f4171967 was qcow2, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:20:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:20 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:20 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:21 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74" returned: 0 in 0.917s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:21 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74 Jun 24 00:20:21 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "cinder-da3aba5b-2428-440a-bf88-2d05090e5a13-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Lock "cinder-da3aba5b-2428-440a-bf88-2d05090e5a13-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "cinder-quobyte-da3aba5b-2428-440a-bf88-2d05090e5a13" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Lock "cinder-quobyte-da3aba5b-2428-440a-bf88-2d05090e5a13" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a71b3c-8fb1-4eba-bf2d-9848eac6fb5a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:21 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c7a25625-0302-4c1d-a26b-40dbb7499d74" returned: 0 in 0.874s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Lock "cinder-quobyte-c7a25625-0302-4c1d-a26b-40dbb7499d74" released by "delete_volume" :: held 1.846s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:21 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 Jun 24 00:20:21 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Created reservations ['e5927ba3-fe83-42f8-87de-f11372067f09', '5943a80c-ac9d-4565-8b68-6c6a4e197868', '7ad41eb8-e377-42ef-b59f-695c1460603a', 'df60694e-841b-4310-ab56-e70a81b49e90'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:22 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:22 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:22 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13" returned: 0 in 1.140s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:22 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13 Jun 24 00:20:22 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:23 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 0 in 2.538s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_txxqkhnsdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:20:23 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Converted 112.00 MB image at 44.07 MB/s Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:23 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 1G Jun 24 00:20:23 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:23 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.053s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Deleted volume successfully. Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b6649106-d03b-44af-8f84-aef8f17af5db tempest-VolumesTestJSON-565548391 None] Lock "cinder-c7a25625-0302-4c1d-a26b-40dbb7499d74-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:23 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-da3aba5b-2428-440a-bf88-2d05090e5a13" returned: 0 in 0.867s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Lock "cinder-quobyte-da3aba5b-2428-440a-bf88-2d05090e5a13" released by "delete_volume" :: held 2.063s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:23 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 1G" returned: 0 in 0.806s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Created reservations ['742c4e56-5a6b-4cfe-8218-82a31eecfff0', '09e087d9-eed4-412f-807b-f35cbfe38ddc', 'a6338841-285b-42af-b573-4bf5098d2eb5', '1b4dbdf6-1fc3-4f6c-beb8-5d3177d53cbc'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76a016-5713-49f4-bb8a-f908c43df0a6]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:24 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:24 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:24 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:24 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:24 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 0 in 0.886s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:24 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.834s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Deleted volume successfully. Jun 24 00:20:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0ff29cb9-bf25-4f9f-81ba-e3085663e2c4 tempest-ServersNegativeTestJSON-1798589168 None] Lock "cinder-da3aba5b-2428-440a-bf88-2d05090e5a13-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:24 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:24 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "cinder-f31546a0-f436-46a8-bdac-8c62b8a99176-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Lock "cinder-f31546a0-f436-46a8-bdac-8c62b8a99176-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "cinder-quobyte-f31546a0-f436-46a8-bdac-8c62b8a99176" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Lock "cinder-quobyte-f31546a0-f436-46a8-bdac-8c62b8a99176" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4040e06f-974a-4905-8e20-37f56cfdca9f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:25 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 Jun 24 00:20:25 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:25 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 1 in 0.882s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Downloaded image f57f6d67-fa39-4fca-b804-ab80f4171967 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}])) to volume 72ec45c0-633d-4f24-875b-3d5975f4fc15 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Temporary image f57f6d67-fa39-4fca-b804-ab80f4171967 for user 82d4107ad83f4b848687e59add859afc is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Marking volume 72ec45c0-633d-4f24-875b-3d5975f4fc15 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Copying metadata from image f57f6d67-fa39-4fca-b804-ab80f4171967 to 72ec45c0-633d-4f24-875b-3d5975f4fc15. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Creating volume glance metadata for volume 72ec45c0-633d-4f24-875b-3d5975f4fc15 backed by image f57f6d67-fa39-4fca-b804-ab80f4171967 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24b8138-ef31-4003-b7b6-4f6e31bf9c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ec45c0-633d-4f24-875b-3d5975f4fc15', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a966a255-fb2b-459e-b0f2-fe9cd8c99488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Volume volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 (72ec45c0-633d-4f24-875b-3d5975f4fc15): created successfully Jun 24 00:20:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a966a255-fb2b-459e-b0f2-fe9cd8c99488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Flow 'volume_create_manager' (44b318d7-3761-4afd-b169-2d7091c1060c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-66534510-37f2-4cfb-8b6b-1d0de8da5c87 tempest-VolumesExtendTest-500412092 None] Created volume successfully. Jun 24 00:20:26 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176" returned: 0 in 1.299s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:26 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176 Jun 24 00:20:26 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:26 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2e53c0-fd98-48bf-89f9-582c35e3d41a]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:27 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:27 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:27 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f31546a0-f436-46a8-bdac-8c62b8a99176" returned: 0 in 0.936s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Lock "cinder-quobyte-f31546a0-f436-46a8-bdac-8c62b8a99176" released by "delete_volume" :: held 2.314s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Created reservations ['97a5aee4-0aa0-4078-9ecb-41ca9ffeb88e', 'd80d5413-5b33-4624-8458-e8a447786ef9', 'c2949991-6bf9-46a7-bf7a-ef5eeb207cba', '0f1d567e-5fd7-4d2b-9e7c-578031b53877'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:27 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:27 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:28 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 0 in 1.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:28 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:28 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:28 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.087s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:28 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Deleted volume successfully. Jun 24 00:20:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5c89a55b-7730-4292-a6da-92d878befe7e tempest-ServersNegativeTestJSON-1798589168 None] Lock "cinder-f31546a0-f436-46a8-bdac-8c62b8a99176-delete_volume" released by "delete_volume" :: held 3.799s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:29 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 1 in 1.521s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:20:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 2G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 2G" returned: 0 in 0.094s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.970s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d9e6abd1-3e0d-4396-a67d-32832b6ea595 tempest-VolumesExtendTest-500412092 None] Extend volume completed successfully. Jun 24 00:20:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Acquiring lock "cinder-72ec45c0-633d-4f24-875b-3d5975f4fc15-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Lock "cinder-72ec45c0-633d-4f24-875b-3d5975f4fc15-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Acquiring lock "cinder-quobyte-72ec45c0-633d-4f24-875b-3d5975f4fc15" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Lock "cinder-quobyte-72ec45c0-633d-4f24-875b-3d5975f4fc15" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ce44f8-c92d-469c-9dc7-e3cfaa406d96]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:31 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:31 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:32 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 0 in 1.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:32 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:32 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:33 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 1 in 1.201s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:20:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:33 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15 Jun 24 00:20:33 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:34 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72ec45c0-633d-4f24-875b-3d5975f4fc15" returned: 0 in 1.072s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Lock "cinder-quobyte-72ec45c0-633d-4f24-875b-3d5975f4fc15" released by "delete_volume" :: held 3.653s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Created reservations ['8cac049c-c98f-495c-81e4-0d0dcf290d57', '2ef8988e-217f-4a07-b6c9-676b9443d361', '1f6fb0bc-7201-41b6-b030-a1c77c8f0711', '53882f67-be90-4273-bdce-52197468f6d5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:34 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:34 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-df11c50b-bd73-4adc-be58-1bbefcf49a74 tempest-GroupsV320Test-1279158719 None] Group tempest-GroupsV320Test-Group-152243970: creating Jun 24 00:20:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-df11c50b-bd73-4adc-be58-1bbefcf49a74 tempest-GroupsV320Test-1279158719 None] Group tempest-GroupsV320Test-Group-152243970: created successfully Jun 24 00:20:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-df11c50b-bd73-4adc-be58-1bbefcf49a74 tempest-GroupsV320Test-1279158719 None] Create group completed successfully. Jun 24 00:20:35 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.763s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Deleted volume successfully. Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=80,cinder:INSERT=27,cinder:UPDATE=92,cinder:DELETE=10 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a12bf38b-44c0-4006-ac15-4ee46cf30237 tempest-VolumesExtendTest-500412092 None] Lock "cinder-72ec45c0-633d-4f24-875b-3d5975f4fc15-delete_volume" released by "delete_volume" :: held 4.819s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Flow 'volume_create_manager' (eb4a7359-9814-477e-b8f4-ec3c13c12390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d10e31-efb9-4f70-9413-14c978fd098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d10e31-efb9-4f70-9413-14c978fd098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2128202980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8a606e-bee6-4f94-8731-23979ca1e704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b824f161ac9460f8982b5252f982fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:36Z,use_quota=True,user_id='82d4107ad83f4b848687e59add859afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09419fd1-6499-48f4-b22d-4cdedf7eed3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09419fd1-6499-48f4-b22d-4cdedf7eed3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829c1f41-4269-4a29-a421-a86bb4ab36c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829c1f41-4269-4a29-a421-a86bb4ab36c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8a606e-bee6-4f94-8731-23979ca1e704', 'volume_name': 'volume-dc8a606e-bee6-4f94-8731-23979ca1e704', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecad8efb-bafe-479a-9e62-c6b3b0c48e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecad8efb-bafe-479a-9e62-c6b3b0c48e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092d1305-d187-4303-a448-d705f51a4383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Volume dc8a606e-bee6-4f94-8731-23979ca1e704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8a606e-bee6-4f94-8731-23979ca1e704', 'volume_size': 1} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2128202980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8a606e-bee6-4f94-8731-23979ca1e704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b824f161ac9460f8982b5252f982fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:36Z,use_quota=True,user_id='82d4107ad83f4b848687e59add859afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Creating volume dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:35 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:36 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 1073741824 Jun 24 00:20:36 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:36 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=67,cinder:UPDATE=111,cinder:INSERT=30,cinder:DELETE=7 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:20:36 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Created reservations ['75251611-4add-4990-ac32-3bbc7e67ab2a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:36 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:36 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:36 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 1073741824" returned: 0 in 1.031s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:37 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 Jun 24 00:20:37 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:37 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.774s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b4ab068e-f945-45b2-bd56-a9b3ce9f0e67 tempest-GroupsV320Test-1279158719 None] Delete group completed successfully. Jun 24 00:20:37 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704" returned: 0 in 0.778s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092d1305-d187-4303-a448-d705f51a4383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8a606e-bee6-4f94-8731-23979ca1e704', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d12f2c3-c817-4145-83c6-8be6993fb924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:37 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Volume volume-dc8a606e-bee6-4f94-8731-23979ca1e704 (dc8a606e-bee6-4f94-8731-23979ca1e704): created successfully Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d12f2c3-c817-4145-83c6-8be6993fb924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Flow 'volume_create_manager' (eb4a7359-9814-477e-b8f4-ec3c13c12390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5cf391cd-d2be-4cae-a7ff-b749358c75c5 tempest-VolumesExtendTest-500412092 None] Created volume successfully. Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Creating offline snapshot 6e290d15-8b52-4065-8f98-6c2d85dcf513 of volume dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead34a4f-1211-4bb0-8333-4bdf5c97037e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:39 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 Jun 24 00:20:39 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:39 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:39 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:40 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704" returned: 0 in 1.183s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:40 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.922s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:20:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:20:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:20:40 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 1G Jun 24 00:20:40 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:41 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 1G" returned: 0 in 0.988s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8a606e-bee6-4f94-8731-23979ca1e704 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:41 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8a606e-bee6-4f94-8731-23979ca1e704 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 Jun 24 00:20:41 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:42 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8a606e-bee6-4f94-8731-23979ca1e704 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513" returned: 0 in 0.799s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:42 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 is being set with open permissions: ugo+rw Jun 24 00:20:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:42 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 Jun 24 00:20:42 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:43 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513" returned: 0 in 0.673s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:43 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.info Jun 24 00:20:43 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:43 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.info" returned: 0 in 0.744s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:43 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.info is being set with open permissions: ugo+rw Jun 24 00:20:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:43 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.info Jun 24 00:20:43 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:44 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.info" returned: 0 in 0.683s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.208s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6d56bc92-ba2b-47fc-b941-8a9868140ae8 tempest-VolumesExtendTest-500412092 None] Create snapshot completed successfully Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Flow 'volume_create_manager' (81213dac-ebf0-420d-a425-8bb06717a2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760b46f1-67e4-4072-8f52-317020ee586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760b46f1-67e4-4072-8f52-317020ee586e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1875892534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69677706-fe7a-40cd-a281-70273d56e074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb006ce46a4c8e9b3fa96b8d000397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:45Z,use_quota=True,user_id='b6874f44ed4c48eca61a4bf61859d8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c73d77-a591-46cd-ba8b-8802fa72d575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c73d77-a591-46cd-ba8b-8802fa72d575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee9a5e6-6366-43e2-8f57-957a2583dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee9a5e6-6366-43e2-8f57-957a2583dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69677706-fe7a-40cd-a281-70273d56e074', 'volume_name': 'volume-69677706-fe7a-40cd-a281-70273d56e074', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff88d48-1c1e-4925-af00-740635c7e124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff88d48-1c1e-4925-af00-740635c7e124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75f7fee-b62e-4e6b-b144-bc83c78cbbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:45 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Volume 69677706-fe7a-40cd-a281-70273d56e074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69677706-fe7a-40cd-a281-70273d56e074', 'volume_size': 1} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1875892534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69677706-fe7a-40cd-a281-70273d56e074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1bb006ce46a4c8e9b3fa96b8d000397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:45Z,use_quota=True,user_id='b6874f44ed4c48eca61a4bf61859d8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Creating volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:45 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:45 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 1073741824 Jun 24 00:20:45 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb45762f-eb39-4cef-9932-2e67d22f9809 tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:46 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 1073741824" returned: 0 in 0.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:46 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 Jun 24 00:20:46 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-41aedb41-a7fd-45a4-8721-2d6fbc7df19c tempest-BackendsCapabilitiesAdminTestsJSON-774983876 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578163146973, 'free_capacity_gb': 1775.7578163146973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94472) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 24 00:20:46 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074" returned: 0 in 0.633s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb45762f-eb39-4cef-9932-2e67d22f9809 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.983s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a133168a-1481-4ab7-a82c-04a116b92ce1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb45762f-eb39-4cef-9932-2e67d22f9809 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75f7fee-b62e-4e6b-b144-bc83c78cbbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69677706-fe7a-40cd-a281-70273d56e074', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ef2797-0b31-424c-8670-8bb1070e17c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:46 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Volume volume-69677706-fe7a-40cd-a281-70273d56e074 (69677706-fe7a-40cd-a281-70273d56e074): created successfully Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ef2797-0b31-424c-8670-8bb1070e17c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Flow 'volume_create_manager' (81213dac-ebf0-420d-a425-8bb06717a2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1ca4d749-49ca-457a-b38f-e659b78cb478 tempest-SnapshotsActionsTest-1180347118 None] Created volume successfully. Jun 24 00:20:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ecbe8ad6-5ab4-40af-b37d-1655ae3536c2 tempest-BackendsCapabilitiesAdminTestsJSON-774983876 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578163146973, 'free_capacity_gb': 1775.7578163146973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94472) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 24 00:20:46 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 Jun 24 00:20:46 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:47 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb45762f-eb39-4cef-9932-2e67d22f9809 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704" returned: 0 in 0.892s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb45762f-eb39-4cef-9932-2e67d22f9809 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 2G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb45762f-eb39-4cef-9932-2e67d22f9809 tempest-VolumesExtendTest-500412092 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 2G" returned: 0 in 0.146s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb45762f-eb39-4cef-9932-2e67d22f9809 tempest-VolumesExtendTest-500412092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.077s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Creating offline snapshot ee644be9-8732-4d59-a9a8-e38346c728ae of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b226c3-78df-4c13-9834-a0cd2608be7a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bb45762f-eb39-4cef-9932-2e67d22f9809 tempest-VolumesExtendTest-500412092 None] Extend volume completed successfully. Jun 24 00:20:48 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 Jun 24 00:20:48 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:48 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074" returned: 0 in 0.859s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:48 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae 1G Jun 24 00:20:48 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Acquiring lock "cinder-6e290d15-8b52-4065-8f98-6c2d85dcf513-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Lock "cinder-6e290d15-8b52-4065-8f98-6c2d85dcf513-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Acquiring lock "cinder-quobyte-dc8a606e-bee6-4f94-8731-23979ca1e704" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Lock "cinder-quobyte-dc8a606e-bee6-4f94-8731-23979ca1e704" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Acquiring lock "cinder-quobyte-6e290d15-8b52-4065-8f98-6c2d85dcf513" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Lock "cinder-quobyte-6e290d15-8b52-4065-8f98-6c2d85dcf513" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Deleting offline snapshot 6e290d15-8b52-4065-8f98-6c2d85dcf513 of volume dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] snapshot_file for this snap is: volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[57719aa5-2a49-42ae-b28d-0b27270a41ca]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:49 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 Jun 24 00:20:49 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:49 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae 1G" returned: 0 in 0.969s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:49 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:20:49 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:50 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513" returned: 0 in 0.857s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc8a606e-bee6-4f94-8731-23979ca1e704(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:20:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e382f721-e4de-4ca5-89df-aee82b2d60ec]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:50 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 Jun 24 00:20:50 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:50 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.763s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:50 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae is being set with open permissions: ugo+rw Jun 24 00:20:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:50 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:20:50 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:51 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.660s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:51 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704" returned: 0 in 0.824s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:51 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 Jun 24 00:20:51 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:51 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.info Jun 24 00:20:51 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:51 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.info" returned: 0 in 0.639s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:51 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.info is being set with open permissions: ugo+rw Jun 24 00:20:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:51 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.info Jun 24 00:20:51 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:52 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513" returned: 0 in 0.808s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:52 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513 Jun 24 00:20:52 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:52 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.info" returned: 0 in 0.643s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.654s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6a7f6a43-3bad-4fec-bc4f-3aa14cab7b62 tempest-SnapshotsActionsTest-1180347118 None] Create snapshot completed successfully Jun 24 00:20:52 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704.6e290d15-8b52-4065-8f98-6c2d85dcf513" returned: 0 in 0.705s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Lock "cinder-quobyte-6e290d15-8b52-4065-8f98-6c2d85dcf513" released by "_delete_snapshot" :: held 3.320s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Lock "cinder-quobyte-dc8a606e-bee6-4f94-8731-23979ca1e704" released by "delete_snapshot" :: held 3.358s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:52 devstack cinder-volume[94472]: WARNING cinder.quota [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Created reservations ['671f48ad-f807-4a47-a0e9-04a71de574b3', '4a2bb37c-e83d-4632-8879-d3b0ea1d39dd', 'aa7d5867-2878-4868-844c-c57fd67480fa', 'adc7b7da-1082-4b30-a3b1-716b94be98c5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Delete snapshot completed successfully. Jun 24 00:20:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4c55884-44c9-4826-9311-f78b55b8f819 tempest-VolumesExtendTest-500412092 None] Lock "cinder-6e290d15-8b52-4065-8f98-6c2d85dcf513-delete_snapshot" released by "delete_snapshot" :: held 3.540s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c6594bbd-275c-4b27-9ed5-2a2f44eb8725 tempest-GroupSnapshotsV319Test-698083574 None] Group tempest-GroupSnapshotsV319Test-Group-1632566975: creating Jun 24 00:20:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c6594bbd-275c-4b27-9ed5-2a2f44eb8725 tempest-GroupSnapshotsV319Test-698083574 None] Group tempest-GroupSnapshotsV319Test-Group-1632566975: created successfully Jun 24 00:20:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c6594bbd-275c-4b27-9ed5-2a2f44eb8725 tempest-GroupSnapshotsV319Test-698083574 None] Create group completed successfully. Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Creating offline snapshot e669a1fd-9f50-4126-86af-61140c283c7c of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Acquiring lock "cinder-dc8a606e-bee6-4f94-8731-23979ca1e704-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce60099-2900-4990-bd90-1addcbcd4527]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Flow 'volume_create_manager' (57b95205-55f5-47fc-b2a0-eeb31de11940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e56a5e-ca28-4123-bc70-a5c8d0e26e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Lock "cinder-dc8a606e-bee6-4f94-8731-23979ca1e704-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e56a5e-ca28-4123-bc70-a5c8d0e26e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1390907351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda7f489dfcc4d98a61129d3f5f00690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:54Z,use_quota=True,user_id='54125bffbdcc465fbfc3e801e661e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86acbc47-7659-4bd1-9a9c-ff159a2809d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86acbc47-7659-4bd1-9a9c-ff159a2809d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea83c808-62eb-4a40-8040-79079452e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea83c808-62eb-4a40-8040-79079452e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3', 'volume_name': 'volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0df753-0622-45e0-8348-a561d4dcf46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0df753-0622-45e0-8348-a561d4dcf46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9202ec-f51b-4a4d-897a-81d4f9cebfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Volume 36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3', 'volume_size': 1} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Acquiring lock "cinder-quobyte-dc8a606e-bee6-4f94-8731-23979ca1e704" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:53 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:20:53 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Lock "cinder-quobyte-dc8a606e-bee6-4f94-8731-23979ca1e704" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73ec9d-ddd3-4be0-83c6-c1b24e7f5ebb]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:54 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 Jun 24 00:20:54 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:54 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.795s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:54 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c 1G Jun 24 00:20:54 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:54 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704" returned: 0 in 0.807s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:54 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704 Jun 24 00:20:54 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Flow 'volume_create_manager' (44bd8095-bfc5-4341-a34e-679d34980dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9b3ecd-67c2-485a-8382-d67744b1d32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9b3ecd-67c2-485a-8382-d67744b1d32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078656589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a33f95b-3217-4bfb-a17a-8eb38a6c80bb,host='devstack@QuobyteHD#QuobyteHD',id=387309e0-8613-43e5-b5e7-3f2f2ea138fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e7c9f42b4704e0a80cae3105e754d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:55Z,use_quota=True,user_id='834d30f2cc8d4ebd99e957975cc83ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fab20b79-0543-4705-9c30-7f74ff081907),volume_type_id=fab20b79-0543-4705-9c30-7f74ff081907)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a3f801-c5ab-47c0-8243-a395f0486a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a3f801-c5ab-47c0-8243-a395f0486a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f711686b-0ee3-405f-b265-c859af3bd917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f711686b-0ee3-405f-b265-c859af3bd917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387309e0-8613-43e5-b5e7-3f2f2ea138fd', 'volume_name': 'volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f4c4a6-44fc-4af3-9538-eb055f5d7119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f4c4a6-44fc-4af3-9538-eb055f5d7119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f453e2da-a378-45e9-b987-e4ce048b09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:54 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Volume 387309e0-8613-43e5-b5e7-3f2f2ea138fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd', 'volume_size': 1} Jun 24 00:20:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:55 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc8a606e-bee6-4f94-8731-23979ca1e704" returned: 0 in 0.697s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:55 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c 1G" returned: 0 in 0.876s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Lock "cinder-quobyte-dc8a606e-bee6-4f94-8731-23979ca1e704" released by "delete_volume" :: held 1.575s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:55 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c Jun 24 00:20:55 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Created reservations ['351e7141-13f4-4c70-a683-90b8e8327b36', '2a68d6b4-18ea-4e08-b528-1792ac414df1', 'bf4b233c-c7cc-49ef-937e-f6f7cea3c3b2', '3e805f96-01e8-4253-b0ee-de3523bd3d67'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:55 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:20:55 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:56 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c" returned: 0 in 0.701s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:56 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c is being set with open permissions: ugo+rw Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:56 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c Jun 24 00:20:56 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:56 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.673s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:20:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Deleted volume successfully. Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e816bc19-81a6-44cd-b3e0-dfaefd2fc70b tempest-VolumesExtendTest-500412092 None] Lock "cinder-dc8a606e-bee6-4f94-8731-23979ca1e704-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:20:56 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c" returned: 0 in 0.664s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.190s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1390907351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda7f489dfcc4d98a61129d3f5f00690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:54Z,use_quota=True,user_id='54125bffbdcc465fbfc3e801e661e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Creating volume 36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:56 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:56 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 1073741824 Jun 24 00:20:56 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1efe43f9-201d-46ac-888b-c62945798d3c tempest-SnapshotsActionsTest-1180347118 None] Create snapshot completed successfully Jun 24 00:20:57 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 1073741824" returned: 0 in 0.986s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-e669a1fd-9f50-4126-86af-61140c283c7c-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:57 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 Jun 24 00:20:57 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-e669a1fd-9f50-4126-86af-61140c283c7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-quobyte-e669a1fd-9f50-4126-86af-61140c283c7c" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:20:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-e669a1fd-9f50-4126-86af-61140c283c7c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Deleting offline snapshot e669a1fd-9f50-4126-86af-61140c283c7c of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] snapshot_file for this snap is: volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cd0c3b-4f40-48d5-8c4f-e0d5025815bd]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:58 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c Jun 24 00:20:58 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:58 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3" returned: 0 in 0.789s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.796s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4a33f95b-3217-4bfb-a17a-8eb38a6c80bb,created_at=2026-06-23T22:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078656589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a33f95b-3217-4bfb-a17a-8eb38a6c80bb,host='devstack@QuobyteHD#QuobyteHD',id=387309e0-8613-43e5-b5e7-3f2f2ea138fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e7c9f42b4704e0a80cae3105e754d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:55Z,use_quota=True,user_id='834d30f2cc8d4ebd99e957975cc83ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fab20b79-0543-4705-9c30-7f74ff081907),volume_type_id=fab20b79-0543-4705-9c30-7f74ff081907)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Creating volume 387309e0-8613-43e5-b5e7-3f2f2ea138fd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:20:58 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9202ec-f51b-4a4d-897a-81d4f9cebfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:58 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd 1073741824 Jun 24 00:20:58 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0d76b2-e309-465b-9d1a-2e08d9e70b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Volume volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 (36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3): created successfully Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0d76b2-e309-465b-9d1a-2e08d9e70b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Flow 'volume_create_manager' (57b95205-55f5-47fc-b2a0-eeb31de11940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-dfbb45de-c1b0-4672-88e9-a399f6164033 tempest-AttachVolumeTestJSON-952325414 None] Created volume successfully. Jun 24 00:20:58 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c" returned: 0 in 0.887s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d45dd2d-866b-4dc9-a7c5-8c9ca33d8068]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:20:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:59 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:20:59 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Flow 'volume_create_manager' (f1cebc3f-76e5-4bb0-aca9-5b76833032b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d934d6-351c-473d-ba37-641e0228897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d934d6-351c-473d-ba37-641e0228897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1550085866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7b2822-e567-43e2-b3d2-bd1a33e126f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d481559ee5c451b8a03c996cb2ba252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:59Z,use_quota=True,user_id='efb89616c1c5474e8eb6ba1f26b8887f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa8a103-7d69-4855-b174-45d03cd3a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa8a103-7d69-4855-b174-45d03cd3a844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bc952c-6e45-41f2-845e-a8dd74aece6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bc952c-6e45-41f2-845e-a8dd74aece6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a7b2822-e567-43e2-b3d2-bd1a33e126f5', 'volume_name': 'volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c14f68-d8bc-4f60-9de5-cc9ce222efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c14f68-d8bc-4f60-9de5-cc9ce222efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9baae7-01c0-4bf0-8f16-e1309f21efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:20:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Volume 6a7b2822-e567-43e2-b3d2-bd1a33e126f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5', 'volume_size': 1} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:20:59 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd 1073741824" returned: 0 in 1.010s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:59 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd Jun 24 00:20:59 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:20:59 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.882s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:20:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:20:59 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c Jun 24 00:20:59 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:00 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd" returned: 0 in 0.667s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1550085866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7b2822-e567-43e2-b3d2-bd1a33e126f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d481559ee5c451b8a03c996cb2ba252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:20:59Z,use_quota=True,user_id='efb89616c1c5474e8eb6ba1f26b8887f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Creating volume 6a7b2822-e567-43e2-b3d2-bd1a33e126f5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:21:00 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f453e2da-a378-45e9-b987-e4ce048b09de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:00 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 1073741824 Jun 24 00:21:00 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbc6a26-fc3f-4ede-a822-7200748a900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Volume volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd (387309e0-8613-43e5-b5e7-3f2f2ea138fd): created successfully Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbc6a26-fc3f-4ede-a822-7200748a900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Flow 'volume_create_manager' (44bd8095-bfc5-4341-a34e-679d34980dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:21:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a88756a5-ee22-44db-82cd-dd5fef525242 tempest-GroupSnapshotsV319Test-698083574 None] Created volume successfully. Jun 24 00:21:00 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c" returned: 0 in 0.958s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:00 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c Jun 24 00:21:00 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] GroupSnapshot f9ad3098-f661-4b1e-9698-c655b809101d: creating. Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Group snapshot f9ad3098-f661-4b1e-9698-c655b809101d: creating. {{(pid=94472) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:01 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 1073741824" returned: 0 in 0.893s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:01 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 Jun 24 00:21:01 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:01 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e669a1fd-9f50-4126-86af-61140c283c7c" returned: 0 in 0.770s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-e669a1fd-9f50-4126-86af-61140c283c7c" released by "_delete_snapshot" :: held 3.629s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" released by "delete_snapshot" :: held 3.664s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Created reservations ['97c8b5d5-8196-47e4-90c8-0bc3cf965497', '9fc1a958-652d-40c2-a455-cdb56a86b1f4', 'fe2d2ba4-23c3-4618-b250-02f16d418ac5', 'ab0daee2-5684-4c5a-a20f-5786ac6bcce4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Delete snapshot completed successfully. Jun 24 00:21:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bbbe6a21-974e-4e17-a3a7-29e3ede67b2d tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-e669a1fd-9f50-4126-86af-61140c283c7c-delete_snapshot" released by "delete_snapshot" :: held 3.810s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:02 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5" returned: 0 in 0.755s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.023s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9baae7-01c0-4bf0-8f16-e1309f21efbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5f8014-ba63-4c2f-9960-67369b742989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Creating offline snapshot 5a84660b-7e05-4e26-b80b-13e353e365b3 of volume 387309e0-8613-43e5-b5e7-3f2f2ea138fd {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:21:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Volume volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 (6a7b2822-e567-43e2-b3d2-bd1a33e126f5): created successfully Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5f8014-ba63-4c2f-9960-67369b742989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Flow 'volume_create_manager' (f1cebc3f-76e5-4bb0-aca9-5b76833032b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ad61e-633a-4b34-bca8-8a7cc38e1ed8]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-028f6b03-41fe-479e-a2c8-00e02c827bd9 tempest-VolumesNegativeTest-578869204 None] Created volume successfully. Jun 24 00:21:02 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd Jun 24 00:21:02 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:03 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd" returned: 0 in 1.008s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:03 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 1G Jun 24 00:21:03 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-b307da48-0023-45bc-aa5b-eb398c764f58 req-8deb1ff6-eca4-4279-bc30-1c5c7666907d tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:04 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 1G" returned: 0 in 0.967s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:04 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 Jun 24 00:21:04 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:04 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3" returned: 0 in 0.683s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:04 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:21:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:04 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 Jun 24 00:21:04 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:05 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3" returned: 0 in 0.609s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:05 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.info Jun 24 00:21:05 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:06 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.info" returned: 0 in 0.616s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:06 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:21:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:06 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.info Jun 24 00:21:06 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:06 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.info" returned: 0 in 0.626s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.641s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.114s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Creating offline snapshot 8ea395f9-d565-4ae6-8025-376146d28d86 of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:21:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[678fd3ff-c3ad-4f49-8a73-a75af0692ae4]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3bc3da58-1636-494f-9362-f5d6652a05d9 tempest-GroupSnapshotsV319Test-698083574 None] group_snapshot f9ad3098-f661-4b1e-9698-c655b809101d: created successfully Jun 24 00:21:06 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:06 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:07 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.749s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:07 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 1G Jun 24 00:21:07 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] group_snapshot f9ad3098-f661-4b1e-9698-c655b809101d: deleting Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] group_snapshot f9ad3098-f661-4b1e-9698-c655b809101d: deleting {{(pid=94472) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Acquiring lock "cinder-quobyte-387309e0-8613-43e5-b5e7-3f2f2ea138fd" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Lock "cinder-quobyte-387309e0-8613-43e5-b5e7-3f2f2ea138fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Acquiring lock "cinder-quobyte-5a84660b-7e05-4e26-b80b-13e353e365b3" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Lock "cinder-quobyte-5a84660b-7e05-4e26-b80b-13e353e365b3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Deleting offline snapshot 5a84660b-7e05-4e26-b80b-13e353e365b3 of volume 387309e0-8613-43e5-b5e7-3f2f2ea138fd {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] snapshot_file for this snap is: volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3479656b-28bd-49da-bf8e-b5054e42c354]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:08 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 Jun 24 00:21:08 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:08 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 1G" returned: 0 in 1.061s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:08 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 Jun 24 00:21:08 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:08 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3" returned: 0 in 0.953s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:08 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c864f21f-93fa-4899-9abd-01e8d2a7b299]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:09 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd Jun 24 00:21:09 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:09 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86" returned: 0 in 0.904s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:09 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 is being set with open permissions: ugo+rw Jun 24 00:21:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:09 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 Jun 24 00:21:09 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:09 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd" returned: 0 in 1.015s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:10 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 Jun 24 00:21:10 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:10 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86" returned: 0 in 0.762s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.617s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-b307da48-0023-45bc-aa5b-eb398c764f58 req-8deb1ff6-eca4-4279-bc30-1c5c7666907d tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.103s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5164fe1f-fe43-438b-87a3-7b71cd7ec03a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-b307da48-0023-45bc-aa5b-eb398c764f58 req-8deb1ff6-eca4-4279-bc30-1c5c7666907d tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eed4a2e7-c199-4fa1-97c0-1479c1e5a19a tempest-SnapshotsActionsTest-1180347118 None] Create snapshot completed successfully Jun 24 00:21:10 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 Jun 24 00:21:10 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:10 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3" returned: 0 in 0.920s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:10 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3 Jun 24 00:21:10 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-8ea395f9-d565-4ae6-8025-376146d28d86-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-8ea395f9-d565-4ae6-8025-376146d28d86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-quobyte-8ea395f9-d565-4ae6-8025-376146d28d86" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-8ea395f9-d565-4ae6-8025-376146d28d86" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Deleting offline snapshot 8ea395f9-d565-4ae6-8025-376146d28d86 of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] snapshot_file for this snap is: volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[74911554-0227-41c1-8c0a-cbd26523f9ce]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:11 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-b307da48-0023-45bc-aa5b-eb398c764f58 req-8deb1ff6-eca4-4279-bc30-1c5c7666907d tempest-AttachVolumeTestJSON-952325414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3" returned: 0 in 0.860s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-b307da48-0023-45bc-aa5b-eb398c764f58 req-8deb1ff6-eca4-4279-bc30-1c5c7666907d tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.902s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-b307da48-0023-45bc-aa5b-eb398c764f58 req-8deb1ff6-eca4-4279-bc30-1c5c7666907d tempest-AttachVolumeTestJSON-952325414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e987ffa6-8e0d-4342-bbfe-f45d52d9ad9f', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:21:11 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 Jun 24 00:21:11 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-b307da48-0023-45bc-aa5b-eb398c764f58 req-8deb1ff6-eca4-4279-bc30-1c5c7666907d tempest-AttachVolumeTestJSON-952325414 None] attachment_update completed successfully. Jun 24 00:21:11 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd.5a84660b-7e05-4e26-b80b-13e353e365b3" returned: 0 in 0.711s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Lock "cinder-quobyte-5a84660b-7e05-4e26-b80b-13e353e365b3" released by "_delete_snapshot" :: held 3.731s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Lock "cinder-quobyte-387309e0-8613-43e5-b5e7-3f2f2ea138fd" released by "delete_snapshot" :: held 3.760s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:11 devstack cinder-volume[94472]: WARNING cinder.quota [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-749776178 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-749776178, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:21:11 devstack cinder-volume[94472]: WARNING cinder.quota [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-749776178 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-749776178, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:21:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] Created reservations ['33aec9fa-d0c1-4515-831e-4dc11f2fa8bd', '6b1769f6-58d9-4942-aa66-3c34ef5f8751', 'e5fed737-5369-46d9-b8cf-ce84420446ea', '057dd238-48b9-426f-a166-7b754231ec87'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5a0ab378-5ec2-41f3-b367-5eb4363435bc tempest-GroupSnapshotsV319Test-698083574 None] group_snapshot f9ad3098-f661-4b1e-9698-c655b809101d: deleted successfully Jun 24 00:21:12 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86" returned: 0 in 0.832s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafbcb4d-1227-40bd-8068-ddcf76881372]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:12 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:12 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Acquiring lock "cinder-quobyte-387309e0-8613-43e5-b5e7-3f2f2ea138fd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Lock "cinder-quobyte-387309e0-8613-43e5-b5e7-3f2f2ea138fd" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91d39c-47fc-4fd4-8bc7-33c8e23eaf83]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:13 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.933s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:13 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 Jun 24 00:21:13 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:13 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd Jun 24 00:21:13 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:13 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd" returned: 0 in 0.916s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:13 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd Jun 24 00:21:13 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:13 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86" returned: 0 in 0.866s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:13 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86 Jun 24 00:21:13 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:14 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-387309e0-8613-43e5-b5e7-3f2f2ea138fd" returned: 0 in 0.691s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Lock "cinder-quobyte-387309e0-8613-43e5-b5e7-3f2f2ea138fd" released by "delete_volume" :: held 1.708s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:14 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8ea395f9-d565-4ae6-8025-376146d28d86" returned: 0 in 0.698s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-8ea395f9-d565-4ae6-8025-376146d28d86" released by "_delete_snapshot" :: held 3.428s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Created reservations ['1745e0cf-27b3-4a69-b359-48d9e80265eb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" released by "delete_snapshot" :: held 3.455s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:14 devstack cinder-volume[94472]: WARNING cinder.quota [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-749776178 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-749776178, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Created reservations ['6164d851-b525-41c4-82be-b1916e5f1274', 'f2ae2bd5-1501-4603-b0c4-d9653b4f0c9a', 'a060a165-e6c0-4b68-bba9-fc52a0a2591d', 'bc23d7b3-172d-487c-b0bb-15ae7a6c0a02'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Created reservations ['ea2882ef-0be7-46ef-9d79-dd3290e65be3', '8015f86c-3774-4bb0-b097-ac52504e4cba', 'b12ac9d2-52ff-4dcf-847d-ea38137ee6ad', '6ae2ea9b-8b6b-43b0-9aa9-78f80b918985'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Delete snapshot completed successfully. Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0b0d3934-796d-4d79-bce5-00dd01c6303c tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-8ea395f9-d565-4ae6-8025-376146d28d86-delete_snapshot" released by "delete_snapshot" :: held 3.618s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:14 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:21:14 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:15 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.646s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:21:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-154314d7-5356-4335-a9a6-3ebb7b2cc862 tempest-GroupSnapshotsV319Test-698083574 None] Delete group completed successfully. Jun 24 00:21:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Creating offline snapshot e121a985-6d37-49b5-a5de-b44ac260edf4 of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:21:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1df6811-def5-415f-a6b8-387dac2eae56]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:16 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:16 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:17 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 1.227s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:17 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 1G Jun 24 00:21:17 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:18 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 1G" returned: 0 in 1.597s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:18 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 Jun 24 00:21:18 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:20 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4" returned: 0 in 1.806s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:20 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 is being set with open permissions: ugo+rw Jun 24 00:21:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:20 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 Jun 24 00:21:20 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:21 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4" returned: 0 in 0.807s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.628s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-049700cd-5f63-4210-9945-0bfa05e68da7 tempest-SnapshotsActionsTest-1180347118 None] Create snapshot completed successfully Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-e121a985-6d37-49b5-a5de-b44ac260edf4-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-e121a985-6d37-49b5-a5de-b44ac260edf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-quobyte-e121a985-6d37-49b5-a5de-b44ac260edf4" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-e121a985-6d37-49b5-a5de-b44ac260edf4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Deleting offline snapshot e121a985-6d37-49b5-a5de-b44ac260edf4 of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] snapshot_file for this snap is: volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9572c3d5-5c8f-4f02-9d01-f49c05724979]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:22 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 Jun 24 00:21:22 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:23 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4" returned: 0 in 1.092s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c53f6b0-600f-4154-b83b-d25d4d11b63b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:23 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:23 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e6ca14c4-baaf-41b5-a7f6-ba2c2df3df4f tempest-GroupsTest-2072783841 None] Group tempest-Group1-2038116074: creating Jun 24 00:21:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e6ca14c4-baaf-41b5-a7f6-ba2c2df3df4f tempest-GroupsTest-2072783841 None] Group tempest-Group1-2038116074: created successfully Jun 24 00:21:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e6ca14c4-baaf-41b5-a7f6-ba2c2df3df4f tempest-GroupsTest-2072783841 None] Create group completed successfully. Jun 24 00:21:24 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.885s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:24 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 Jun 24 00:21:24 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5c6625f0-b2f1-4521-87b8-8396440f614d tempest-GroupsTest-2072783841 None] Group tempest-Group2-1619105841: creating Jun 24 00:21:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5c6625f0-b2f1-4521-87b8-8396440f614d tempest-GroupsTest-2072783841 None] Group tempest-Group2-1619105841: created successfully Jun 24 00:21:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5c6625f0-b2f1-4521-87b8-8396440f614d tempest-GroupsTest-2072783841 None] Create group completed successfully. Jun 24 00:21:25 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4" returned: 0 in 0.917s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:25 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4 Jun 24 00:21:25 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:26 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.e121a985-6d37-49b5-a5de-b44ac260edf4" returned: 0 in 0.674s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-e121a985-6d37-49b5-a5de-b44ac260edf4" released by "_delete_snapshot" :: held 3.695s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" released by "delete_snapshot" :: held 3.721s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Created reservations ['dd48d599-6222-4ef1-940f-a62ac4ad47a9', '7b369999-1fb3-4864-b5f6-a0be4f5b8072', '3fe11cf2-4bad-4eff-9be5-0680e0f057a6', 'bf489578-e47c-4259-b387-c989a9e3542c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Delete snapshot completed successfully. Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ca8c8a08-d251-4531-9f9a-1c3da3013dec tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-e121a985-6d37-49b5-a5de-b44ac260edf4-delete_snapshot" released by "delete_snapshot" :: held 3.881s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Flow 'volume_create_manager' (523de367-0c80-473d-b981-6e11e279a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06dc452-3a90-44dc-bc58-cfa84f9a77a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06dc452-3a90-44dc-bc58-cfa84f9a77a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-16021703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=159e642f-8a30-4813-907a-a662cb842de1,host='devstack@QuobyteHD#QuobyteHD',id=e2c25d88-4b59-47c1-b921-142bdb660860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44bca55699a4e7692697248db3b5648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:21:27Z,use_quota=True,user_id='fb9ff9365f2745bf9b73ece6f54659f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55e197b8-7f00-4d7c-b1cb-287532e4c4e7),volume_type_id=55e197b8-7f00-4d7c-b1cb-287532e4c4e7)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a098eef-55a7-4749-a518-463a0d5c9331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a098eef-55a7-4749-a518-463a0d5c9331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021612e3-5711-43fc-90fc-5a3147d8ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021612e3-5711-43fc-90fc-5a3147d8ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c25d88-4b59-47c1-b921-142bdb660860', 'volume_name': 'volume-e2c25d88-4b59-47c1-b921-142bdb660860', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048b5ccf-795c-4ba9-bc3e-880625475c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048b5ccf-795c-4ba9-bc3e-880625475c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac44fac-ca99-4eb4-b1ca-af3c913b5251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Volume e2c25d88-4b59-47c1-b921-142bdb660860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c25d88-4b59-47c1-b921-142bdb660860', 'volume_size': 1} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=159e642f-8a30-4813-907a-a662cb842de1,created_at=2026-06-23T22:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-16021703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=159e642f-8a30-4813-907a-a662cb842de1,host='devstack@QuobyteHD#QuobyteHD',id=e2c25d88-4b59-47c1-b921-142bdb660860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44bca55699a4e7692697248db3b5648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:21:27Z,use_quota=True,user_id='fb9ff9365f2745bf9b73ece6f54659f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55e197b8-7f00-4d7c-b1cb-287532e4c4e7),volume_type_id=55e197b8-7f00-4d7c-b1cb-287532e4c4e7)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Creating volume e2c25d88-4b59-47c1-b921-142bdb660860 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:21:26 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:26 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 1073741824 Jun 24 00:21:26 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:27 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 1073741824" returned: 0 in 0.920s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:27 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 Jun 24 00:21:27 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:28 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860" returned: 0 in 0.625s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.531s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Creating offline snapshot 8f642382-6775-47d3-88f5-a90e88c7f7ab of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac44fac-ca99-4eb4-b1ca-af3c913b5251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c25d88-4b59-47c1-b921-142bdb660860', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182615ed-bc4a-42f2-8097-83f35c1d8d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb2596-51a9-4e33-8c25-e1d266fb799a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Volume volume-e2c25d88-4b59-47c1-b921-142bdb660860 (e2c25d88-4b59-47c1-b921-142bdb660860): created successfully Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182615ed-bc4a-42f2-8097-83f35c1d8d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Flow 'volume_create_manager' (523de367-0c80-473d-b981-6e11e279a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:21:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f4a912c0-882f-40f0-bd54-5a51fe3a7f92 tempest-GroupsTest-2072783841 None] Created volume successfully. Jun 24 00:21:28 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:28 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:29 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.846s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:29 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab 1G Jun 24 00:21:29 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Acquiring lock "cinder-quobyte-e2c25d88-4b59-47c1-b921-142bdb660860" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Lock "cinder-quobyte-e2c25d88-4b59-47c1-b921-142bdb660860" acquired by "delete_volume" :: waited 0.055s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[af75f9d4-ee82-48eb-ae94-a6c165f43fa0]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:30 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 Jun 24 00:21:30 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:30 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab 1G" returned: 0 in 0.980s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:30 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab Jun 24 00:21:30 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:30 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860" returned: 0 in 0.985s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:30 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860 Jun 24 00:21:30 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:31 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab" returned: 0 in 0.870s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:31 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab is being set with open permissions: ugo+rw Jun 24 00:21:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:31 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab Jun 24 00:21:31 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:32 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e2c25d88-4b59-47c1-b921-142bdb660860" returned: 0 in 1.117s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Lock "cinder-quobyte-e2c25d88-4b59-47c1-b921-142bdb660860" released by "delete_volume" :: held 2.197s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:32 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab" returned: 0 in 0.890s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.733s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Created reservations ['2e1564c3-a2ef-41c8-9aca-e5e45d536e2e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7f0e951a-609c-414f-a902-cb842e197433 tempest-SnapshotsActionsTest-1180347118 None] Create snapshot completed successfully Jun 24 00:21:32 devstack cinder-volume[94472]: WARNING cinder.quota [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-117137565 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-117137565, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:21:32 devstack cinder-volume[94472]: WARNING cinder.quota [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-117137565 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-117137565, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Created reservations ['a4d51a91-21e5-41fc-ba0c-d43d784fecd9', 'd0ca6097-79da-4c7f-8503-de949c4596ac', '7c11ffa8-43da-4fae-8100-e540ec0a7738', '220feb39-82d0-47ff-bc76-2ca45999e1e4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:32 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:21:32 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-8f642382-6775-47d3-88f5-a90e88c7f7ab-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-8f642382-6775-47d3-88f5-a90e88c7f7ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Acquiring lock "cinder-quobyte-8f642382-6775-47d3-88f5-a90e88c7f7ab" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-8f642382-6775-47d3-88f5-a90e88c7f7ab" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Deleting offline snapshot 8f642382-6775-47d3-88f5-a90e88c7f7ab of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] snapshot_file for this snap is: volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835be69-a7a8-4338-8372-c16751c1bad7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:33 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.856s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:21:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8ec4d9a9-5188-4447-b706-03c49c3e98a7 tempest-GroupsTest-2072783841 None] Delete group completed successfully. Jun 24 00:21:33 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab Jun 24 00:21:33 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Created reservations ['cd87205b-8882-46c0-9714-ef0e189908b0'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:34 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:21:34 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:34 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab" returned: 0 in 1.211s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f621df-6d19-41c1-b785-fe9c48c6cbcc]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:34 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:34 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:34 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.990s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:34 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:21:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-40774424-4cc6-4d51-9d80-220abbb7cf4e tempest-GroupsTest-2072783841 None] Delete group completed successfully. Jun 24 00:21:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2330e06c-c735-4924-a3e8-453c41fcb41b tempest-GroupsTest-2072783841 None] Group tempest-GroupsTest-Group-1015235138: creating Jun 24 00:21:35 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=102,cinder:SELECT=106,cinder:INSERT=23,cinder:DELETE=6 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:21:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2330e06c-c735-4924-a3e8-453c41fcb41b tempest-GroupsTest-2072783841 None] Group tempest-GroupsTest-Group-1015235138: created successfully Jun 24 00:21:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2330e06c-c735-4924-a3e8-453c41fcb41b tempest-GroupsTest-2072783841 None] Create group completed successfully. Jun 24 00:21:36 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 1.247s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:36 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab Jun 24 00:21:36 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:36 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab" returned: 0 in 0.928s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:36 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab Jun 24 00:21:36 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=98,cinder:UPDATE=94,cinder:INSERT=22,cinder:DELETE=7 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Flow 'volume_create_manager' (8bdb7486-49b9-4de5-b718-f2d59f612d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (834973c3-0efc-47ea-b76e-18d15deda9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (834973c3-0efc-47ea-b76e-18d15deda9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596988218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0b39bc6-162c-4656-95cd-cf1ca06232ea,host='devstack@QuobyteHD#QuobyteHD',id=db3945e5-82e6-4da4-ab72-1fea2f34fcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44bca55699a4e7692697248db3b5648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:21:37Z,use_quota=True,user_id='fb9ff9365f2745bf9b73ece6f54659f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062c4d58-ed5b-4f31-b07f-2c99c4cb6bdf),volume_type_id=062c4d58-ed5b-4f31-b07f-2c99c4cb6bdf)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95edd2fd-f80e-4ebb-a943-a041c1729269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95edd2fd-f80e-4ebb-a943-a041c1729269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb7aad8-19c7-4ea5-a258-cb18b5a7436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb7aad8-19c7-4ea5-a258-cb18b5a7436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3945e5-82e6-4da4-ab72-1fea2f34fcc1', 'volume_name': 'volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4783bd-0a20-498a-aebb-cc4f7486d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4783bd-0a20-498a-aebb-cc4f7486d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c665f9c-18c2-4dfd-82ca-1e07bb5415d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:37 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Volume db3945e5-82e6-4da4-ab72-1fea2f34fcc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1', 'volume_size': 1} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0b39bc6-162c-4656-95cd-cf1ca06232ea,created_at=2026-06-23T22:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596988218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0b39bc6-162c-4656-95cd-cf1ca06232ea,host='devstack@QuobyteHD#QuobyteHD',id=db3945e5-82e6-4da4-ab72-1fea2f34fcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44bca55699a4e7692697248db3b5648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:21:37Z,use_quota=True,user_id='fb9ff9365f2745bf9b73ece6f54659f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062c4d58-ed5b-4f31-b07f-2c99c4cb6bdf),volume_type_id=062c4d58-ed5b-4f31-b07f-2c99c4cb6bdf)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Creating volume db3945e5-82e6-4da4-ab72-1fea2f34fcc1 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:21:37 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:37 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 1073741824 Jun 24 00:21:37 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:37 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.8f642382-6775-47d3-88f5-a90e88c7f7ab" returned: 0 in 0.991s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-8f642382-6775-47d3-88f5-a90e88c7f7ab" released by "_delete_snapshot" :: held 4.531s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" released by "delete_snapshot" :: held 4.559s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Created reservations ['86d4f104-4f41-4f3f-a5c2-278968471858', '82f64e73-8c09-4d9a-b4d9-4950dd0f68bd', '2a6fa2d7-4831-4c09-bd69-7714c3c17c1f', 'd1d96415-54e4-4d97-95c8-9826f4c2e14a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Delete snapshot completed successfully. Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7a5f47bd-4122-4956-8ce3-84cc928e0db9 tempest-SnapshotsActionsTest-1109186335 None] Lock "cinder-8f642382-6775-47d3-88f5-a90e88c7f7ab-delete_snapshot" released by "delete_snapshot" :: held 4.780s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Acquiring lock "cinder-6a7b2822-e567-43e2-b3d2-bd1a33e126f5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Lock "cinder-6a7b2822-e567-43e2-b3d2-bd1a33e126f5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Acquiring lock "cinder-quobyte-6a7b2822-e567-43e2-b3d2-bd1a33e126f5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Lock "cinder-quobyte-6a7b2822-e567-43e2-b3d2-bd1a33e126f5" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f17e01-f5af-4fc6-b6ce-f0043d71c6ba]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:38 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 Jun 24 00:21:38 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:38 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 1073741824" returned: 0 in 1.230s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:39 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 Jun 24 00:21:39 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "cinder-ee644be9-8732-4d59-a9a8-e38346c728ae-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-ee644be9-8732-4d59-a9a8-e38346c728ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "cinder-quobyte-ee644be9-8732-4d59-a9a8-e38346c728ae" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-quobyte-ee644be9-8732-4d59-a9a8-e38346c728ae" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Deleting offline snapshot ee644be9-8732-4d59-a9a8-e38346c728ae of volume 69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] snapshot_file for this snap is: volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bb1a70-c3b1-4f62-9f31-ec4020b2f76e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:39 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:39 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:39 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5" returned: 0 in 0.920s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:39 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5 Jun 24 00:21:39 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:39 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:21:39 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:39 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1" returned: 0 in 0.848s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c665f9c-18c2-4dfd-82ca-1e07bb5415d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757c77a1-66df-4775-a50c-bf4d7c065c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Volume volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 (db3945e5-82e6-4da4-ab72-1fea2f34fcc1): created successfully Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757c77a1-66df-4775-a50c-bf4d7c065c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Flow 'volume_create_manager' (8bdb7486-49b9-4de5-b718-f2d59f612d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:21:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e113ac48-0564-4a98-8363-c53159878572 tempest-GroupsTest-2072783841 None] Created volume successfully. Jun 24 00:21:40 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 1.235s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69677706-fe7a-40cd-a281-70273d56e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2406ed4c-92fd-4759-b31a-d429f4b8b70a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:40 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.051s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:21:40 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6a7b2822-e567-43e2-b3d2-bd1a33e126f5" returned: 0 in 1.109s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Lock "cinder-quobyte-6a7b2822-e567-43e2-b3d2-bd1a33e126f5" released by "delete_volume" :: held 2.105s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Created reservations ['fd18502f-e171-4108-95e6-ec40d04b03eb', '72efcbf9-8531-4c17-b84d-6f2fae6cb2ad', '7aa70ab1-8eec-44ea-829e-bbafe4c8a657', 'f4ac8cba-289f-4716-863f-b3c825235da3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:40 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 Jun 24 00:21:40 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:41 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:21:41 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Flow 'volume_create_manager' (6f1ea88b-afa5-451a-b365-e6b523a5f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e8c919-0158-4130-b158-987d74edeb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e8c919-0158-4130-b158-987d74edeb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2067021718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0b39bc6-162c-4656-95cd-cf1ca06232ea,host='devstack@QuobyteHD#QuobyteHD',id=c5f22e88-30b7-4037-871d-686ad5ac9bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44bca55699a4e7692697248db3b5648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:21:41Z,use_quota=True,user_id='fb9ff9365f2745bf9b73ece6f54659f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062c4d58-ed5b-4f31-b07f-2c99c4cb6bdf),volume_type_id=062c4d58-ed5b-4f31-b07f-2c99c4cb6bdf)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88185bab-e2cc-4688-bde2-414c4678c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88185bab-e2cc-4688-bde2-414c4678c461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211f71c2-677e-47bf-acfc-971b3776ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211f71c2-677e-47bf-acfc-971b3776ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f22e88-30b7-4037-871d-686ad5ac9bf0', 'volume_name': 'volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd150ed9-2d10-466e-bdb2-9718ba058e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd150ed9-2d10-466e-bdb2-9718ba058e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3101eae2-b213-4e96-b8d1-3a76762fef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Volume c5f22e88-30b7-4037-871d-686ad5ac9bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0', 'volume_size': 1} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0b39bc6-162c-4656-95cd-cf1ca06232ea,created_at=2026-06-23T22:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2067021718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0b39bc6-162c-4656-95cd-cf1ca06232ea,host='devstack@QuobyteHD#QuobyteHD',id=c5f22e88-30b7-4037-871d-686ad5ac9bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44bca55699a4e7692697248db3b5648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:21:41Z,use_quota=True,user_id='fb9ff9365f2745bf9b73ece6f54659f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062c4d58-ed5b-4f31-b07f-2c99c4cb6bdf),volume_type_id=062c4d58-ed5b-4f31-b07f-2c99c4cb6bdf)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Creating volume c5f22e88-30b7-4037-871d-686ad5ac9bf0 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:21:41 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:41 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 1073741824 Jun 24 00:21:41 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:41 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074" returned: 0 in 1.086s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:41 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:41 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:42 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.028s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:42 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:21:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Deleted volume successfully. Jun 24 00:21:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a27175f4-7b8e-4ca2-9dbe-9998f6fcf497 tempest-VolumesNegativeTest-578869204 None] Lock "cinder-6a7b2822-e567-43e2-b3d2-bd1a33e126f5-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:42 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 1073741824" returned: 0 in 0.857s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:42 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 Jun 24 00:21:42 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:42 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.987s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:42 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae Jun 24 00:21:42 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:43 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0" returned: 0 in 1.057s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3101eae2-b213-4e96-b8d1-3a76762fef7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4494c183-be33-44ac-9a68-e8121013c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:21:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Volume volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 (c5f22e88-30b7-4037-871d-686ad5ac9bf0): created successfully Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4494c183-be33-44ac-9a68-e8121013c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Flow 'volume_create_manager' (6f1ea88b-afa5-451a-b365-e6b523a5f84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:21:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e2498140-782d-4cb0-b1ea-f651985c975a tempest-GroupsTest-2072783841 None] Created volume successfully. Jun 24 00:21:43 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074.ee644be9-8732-4d59-a9a8-e38346c728ae" returned: 0 in 0.813s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-quobyte-ee644be9-8732-4d59-a9a8-e38346c728ae" released by "_delete_snapshot" :: held 4.286s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" released by "delete_snapshot" :: held 4.317s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-90781a0c-79b3-4f14-9305-955f0c410e3c tempest-GroupsTest-2072783841 None] Update group completed successfully. Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Created reservations ['39b4add5-0541-4e7e-b990-75e714d44a49', '9859b43d-0fa5-4052-9e7e-c126e5356aa6', '1bbea105-f388-473e-8477-4d8cc805e81b', '97849f9d-2d28-4cd4-99cb-8e9d96b09f87'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Delete snapshot completed successfully. Jun 24 00:21:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b78421a0-4343-4990-9b8c-348556e9c09d tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-ee644be9-8732-4d59-a9a8-e38346c728ae-delete_snapshot" released by "delete_snapshot" :: held 4.493s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "cinder-69677706-fe7a-40cd-a281-70273d56e074-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-69677706-fe7a-40cd-a281-70273d56e074-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:45 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c7aa40-b253-41e4-ae9a-cc5446c2f6a2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:45 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 Jun 24 00:21:45 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:45 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a0608b1e-2f2f-4690-9f3a-3c13819faddb tempest-GroupsTest-2072783841 None] Update group completed successfully. Jun 24 00:21:46 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074" returned: 0 in 1.031s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:46 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074 Jun 24 00:21:46 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:46 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69677706-fe7a-40cd-a281-70273d56e074" returned: 0 in 0.717s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-quobyte-69677706-fe7a-40cd-a281-70273d56e074" released by "delete_volume" :: held 1.822s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Created reservations ['95525d33-287f-451a-a534-d2d7156386cb', 'fffcf887-7341-44e8-8d17-469756e93427', '9db26c07-ed58-4a6e-aeb9-94d1605f9095', 'e4226734-178e-4e86-9d53-693bf9a12627'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:46 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:21:46 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Acquiring lock "cinder-quobyte-c5f22e88-30b7-4037-871d-686ad5ac9bf0" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Lock "cinder-quobyte-c5f22e88-30b7-4037-871d-686ad5ac9bf0" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca6ef7-ed42-4ead-84b4-322751b5d6ec]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:47 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 Jun 24 00:21:47 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:47 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.880s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:47 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:21:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Deleted volume successfully. Jun 24 00:21:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-73c56858-6923-49df-9d31-2e1ba29dd5c4 tempest-SnapshotsActionsTest-1180347118 None] Lock "cinder-69677706-fe7a-40cd-a281-70273d56e074-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:48 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0" returned: 0 in 1.000s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:48 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0 Jun 24 00:21:48 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:48 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c5f22e88-30b7-4037-871d-686ad5ac9bf0" returned: 0 in 0.823s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Lock "cinder-quobyte-c5f22e88-30b7-4037-871d-686ad5ac9bf0" released by "delete_volume" :: held 1.898s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:48 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Acquiring lock "cinder-quobyte-db3945e5-82e6-4da4-ab72-1fea2f34fcc1" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:21:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Lock "cinder-quobyte-db3945e5-82e6-4da4-ab72-1fea2f34fcc1" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:21:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[50274457-471b-4d50-898c-d5ac4c200072]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:21:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:49 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 Jun 24 00:21:49 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:50 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1" returned: 0 in 0.978s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:50 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1 Jun 24 00:21:50 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:50 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-db3945e5-82e6-4da4-ab72-1fea2f34fcc1" returned: 0 in 0.902s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Lock "cinder-quobyte-db3945e5-82e6-4da4-ab72-1fea2f34fcc1" released by "delete_volume" :: held 1.932s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Created reservations ['d3b61e0c-dbfd-4752-8c32-fbda1c326248'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:51 devstack cinder-volume[94472]: WARNING cinder.quota [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-191769548 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-191769548, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:21:51 devstack cinder-volume[94472]: WARNING cinder.quota [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-191769548 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-191769548, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Created reservations ['d411cc75-aa64-4059-9bdc-8d2e7893e7d0', '0f9e8411-3912-4bb2-8d0b-e3b67d04733b', '5e8b6c4c-737c-4c89-933f-c6dc2993af87', '9d6d491b-5bde-486f-a815-9204246758e5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Created reservations ['34e09ad0-911f-4484-8cb4-6e8e5de7b780', '9460508d-2d05-41d2-b6ea-6ff1aa1394bd', 'ba8ee4db-65a8-4476-838e-973fc5db72f6', 'dd6a0fd6-da37-47fe-97d0-b116a9612889'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:21:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:21:51 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:21:51 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:21:52 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jun 24 00:21:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.721s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:21:52 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:21:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-87838374-07a2-4adc-8d97-0a7ec19a750c tempest-GroupsTest-2072783841 None] Delete group completed successfully. Jun 24 00:22:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-1975d038-1eec-4afc-a739-a28a16de762a req-7caceebf-9b2f-4f54-89d6-73d81d0687f5 tempest-AttachVolumeTestJSON-952325414 None] Terminate volume connection completed successfully. Jun 24 00:22:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-1975d038-1eec-4afc-a739-a28a16de762a req-7caceebf-9b2f-4f54-89d6-73d81d0687f5 tempest-AttachVolumeTestJSON-952325414 None] Deleting attachment e987ffa6-8e0d-4342-bbfe-f45d52d9ad9f. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:22:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-646e17c0-b486-4d73-a6ce-4e02b89187c8 tempest-GroupsV314Test-977145401 None] Group tempest-GroupsV314Test-Group-1887121823: creating Jun 24 00:22:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-646e17c0-b486-4d73-a6ce-4e02b89187c8 tempest-GroupsV314Test-977145401 None] Group tempest-GroupsV314Test-Group-1887121823: created successfully Jun 24 00:22:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-646e17c0-b486-4d73-a6ce-4e02b89187c8 tempest-GroupsV314Test-977145401 None] Create group completed successfully. Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Flow 'volume_create_manager' (f97ed274-c7cb-40b7-a86c-7e1bd0bd4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd80745-a019-41da-b15d-c53c2fafdea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd80745-a019-41da-b15d-c53c2fafdea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1522451187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7fdef0-9016-4298-81d0-6d65afcdd7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ecf8dfff8548e3bdeafff4e67a3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:02Z,use_quota=True,user_id='501d9ca5f3834b9e800ea85f57a01ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4adb126-e9f6-415e-9c50-6f2ab43040f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4adb126-e9f6-415e-9c50-6f2ab43040f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f400e518-bc27-4113-b95c-97d300316125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f400e518-bc27-4113-b95c-97d300316125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7fdef0-9016-4298-81d0-6d65afcdd7a4', 'volume_name': 'volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2dba2f-11dc-4a4e-9ab2-dd30e3ce4656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2dba2f-11dc-4a4e-9ab2-dd30e3ce4656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f4b76f-ad6a-44df-b684-3402ecfe7181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Volume 7e7fdef0-9016-4298-81d0-6d65afcdd7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4', 'volume_size': 1} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1522451187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7fdef0-9016-4298-81d0-6d65afcdd7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ecf8dfff8548e3bdeafff4e67a3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:02Z,use_quota=True,user_id='501d9ca5f3834b9e800ea85f57a01ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Creating volume 7e7fdef0-9016-4298-81d0-6d65afcdd7a4 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:22:02 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:22:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:02 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 1073741824 Jun 24 00:22:02 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Flow 'volume_create_manager' (8acc1637-4d6c-4826-9fd5-574039d8f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900942bb-e05b-4618-805f-120973352482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900942bb-e05b-4618-805f-120973352482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854559039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6026ca7a-74d1-4738-85cd-dc6b5f33f3d5,host='devstack@QuobyteHD#QuobyteHD',id=2aa398f1-d77f-419b-8a6b-e9309db0b51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12cd1ac07e914d9aa1425260446d7efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:03Z,use_quota=True,user_id='1d8181225bbd4702b2adbabcd90940ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b41715ec-e582-425f-8db9-e4c44b8aba22),volume_type_id=b41715ec-e582-425f-8db9-e4c44b8aba22)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a4516c-25a0-4c44-b71c-7169f24d4255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a4516c-25a0-4c44-b71c-7169f24d4255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7550d26b-aea9-4cbc-9d36-014d1cd11344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7550d26b-aea9-4cbc-9d36-014d1cd11344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa398f1-d77f-419b-8a6b-e9309db0b51b', 'volume_name': 'volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439d1ae3-f930-4ea7-9fbb-ec8cee2369ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439d1ae3-f930-4ea7-9fbb-ec8cee2369ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7236434f-a9a0-47da-b082-42548804a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Volume 2aa398f1-d77f-419b-8a6b-e9309db0b51b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b', 'volume_size': 1} Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:03 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 1073741824" returned: 0 in 1.341s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:04 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 Jun 24 00:22:04 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:05 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" returned: 0 in 1.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] <== create_volume: return (2709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.713s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.741s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6026ca7a-74d1-4738-85cd-dc6b5f33f3d5,created_at=2026-06-23T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854559039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6026ca7a-74d1-4738-85cd-dc6b5f33f3d5,host='devstack@QuobyteHD#QuobyteHD',id=2aa398f1-d77f-419b-8a6b-e9309db0b51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12cd1ac07e914d9aa1425260446d7efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:03Z,use_quota=True,user_id='1d8181225bbd4702b2adbabcd90940ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b41715ec-e582-425f-8db9-e4c44b8aba22),volume_type_id=b41715ec-e582-425f-8db9-e4c44b8aba22)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Creating volume 2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:22:05 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f4b76f-ad6a-44df-b684-3402ecfe7181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70bea19-a53f-4b72-ae58-48111286034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:05 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b 1073741824 Jun 24 00:22:05 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Volume volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 (7e7fdef0-9016-4298-81d0-6d65afcdd7a4): created successfully Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70bea19-a53f-4b72-ae58-48111286034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Flow 'volume_create_manager' (f97ed274-c7cb-40b7-a86c-7e1bd0bd4452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eebfd1b6-d6c5-49fb-88e9-080bb14ba960 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Created volume successfully. Jun 24 00:22:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:06 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b 1073741824" returned: 0 in 1.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:06 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b Jun 24 00:22:06 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:07 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b" returned: 0 in 0.845s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.525s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7236434f-a9a0-47da-b082-42548804a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012d048a-1025-41c0-9e45-c32d2da5eed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Creating offline snapshot c2b7654f-acf9-4473-8efb-3b17526e3b32 of volume 7e7fdef0-9016-4298-81d0-6d65afcdd7a4 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:22:07 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Volume volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b (2aa398f1-d77f-419b-8a6b-e9309db0b51b): created successfully Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012d048a-1025-41c0-9e45-c32d2da5eed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Flow 'volume_create_manager' (8acc1637-4d6c-4826-9fd5-574039d8f10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f61524-bb2f-4b19-b50c-1718a57066ba]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e40a6cf3-0369-446f-aebf-7483d61d19c8 tempest-GroupsV314Test-977145401 None] Created volume successfully. Jun 24 00:22:07 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 Jun 24 00:22:07 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:08 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" returned: 0 in 0.977s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:08 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 1G Jun 24 00:22:08 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:09 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 1G" returned: 0 in 1.367s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:09 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 Jun 24 00:22:09 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:10 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32" returned: 0 in 0.878s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:10 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 is being set with open permissions: ugo+rw Jun 24 00:22:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:10 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 Jun 24 00:22:10 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:11 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32" returned: 0 in 0.706s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:11 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.info Jun 24 00:22:11 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:12 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.info" returned: 0 in 0.664s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:12 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.info is being set with open permissions: ugo+rw Jun 24 00:22:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:12 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.info Jun 24 00:22:12 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:12 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.info" returned: 0 in 0.647s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.374s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.028s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Cloning volume 2aa398f1-d77f-419b-8a6b-e9309db0b51b to volume 4ce05729-75cb-4d7c-9de4-16a952cae639 Jun 24 00:22:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cbcea005-b8c9-44a2-b376-83c8e64784d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Create snapshot completed successfully Jun 24 00:22:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Creating offline snapshot 29765350-dda4-4700-a490-4750fbdf5342 of volume 2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:22:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b3e1e2-6274-40a4-912f-6ce220a11c25]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:13 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b Jun 24 00:22:13 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Flow 'volume_create_manager' (a371d82e-454b-4751-8b75-f52093ec0a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd93a77-9771-494b-8c8a-796c1a3fc89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd93a77-9771-494b-8c8a-796c1a3fc89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-800103970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910a3af9-863a-4849-8bda-2a9b24eceac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dbab2e91c8481a80b6921927c27721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:13Z,use_quota=True,user_id='d329ab6a61a34b09a317454e3c023977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a198589c-bb1f-447a-92d2-58a851b700bb),volume_type_id=a198589c-bb1f-447a-92d2-58a851b700bb)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa946cb3-31f3-487a-9b57-4e3e9be613ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa946cb3-31f3-487a-9b57-4e3e9be613ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1733e4cd-c2d9-4efd-bba1-33b35829f766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1733e4cd-c2d9-4efd-bba1-33b35829f766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910a3af9-863a-4849-8bda-2a9b24eceac6', 'volume_name': 'volume-910a3af9-863a-4849-8bda-2a9b24eceac6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1e7de6-3db0-47de-87be-c2a4ca4d5c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1e7de6-3db0-47de-87be-c2a4ca4d5c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6ddde1-9b5f-4984-8694-4dd3faac916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Volume 910a3af9-863a-4849-8bda-2a9b24eceac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910a3af9-863a-4849-8bda-2a9b24eceac6', 'volume_size': 1} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Flow 'volume_create_manager' (cc5925ce-1a8b-4ed7-8b90-5127e0890d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eb5c72-85b3-4370-affb-35f8ade67b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eb5c72-85b3-4370-affb-35f8ade67b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-447882540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b531bd9-badc-443e-9ed8-05e14ac79120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dbab2e91c8481a80b6921927c27721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:14Z,use_quota=True,user_id='d329ab6a61a34b09a317454e3c023977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7170dfb-9578-43ff-9ab7-1bcd0929fe62),volume_type_id=f7170dfb-9578-43ff-9ab7-1bcd0929fe62)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed4366f-1dd3-4f7c-bfd7-ef07fee43cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed4366f-1dd3-4f7c-bfd7-ef07fee43cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a1c89c-f245-4a3f-80a0-c2ebb521abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a1c89c-f245-4a3f-80a0-c2ebb521abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b531bd9-badc-443e-9ed8-05e14ac79120', 'volume_name': 'volume-7b531bd9-badc-443e-9ed8-05e14ac79120', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70836b07-a3be-4747-a71a-db687616aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70836b07-a3be-4747-a71a-db687616aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7814c09-9207-40b9-9f4b-b723f877d54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Volume 7b531bd9-badc-443e-9ed8-05e14ac79120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b531bd9-badc-443e-9ed8-05e14ac79120', 'volume_size': 1} Jun 24 00:22:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:14 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b" returned: 0 in 1.180s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:14 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 1G Jun 24 00:22:14 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "cinder-c2b7654f-acf9-4473-8efb-3b17526e3b32-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-c2b7654f-acf9-4473-8efb-3b17526e3b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "cinder-quobyte-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-quobyte-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "cinder-quobyte-c2b7654f-acf9-4473-8efb-3b17526e3b32" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-quobyte-c2b7654f-acf9-4473-8efb-3b17526e3b32" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Deleting offline snapshot c2b7654f-acf9-4473-8efb-3b17526e3b32 of volume 7e7fdef0-9016-4298-81d0-6d65afcdd7a4 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] snapshot_file for this snap is: volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4431bd3-0266-4b88-874e-70fb89487d4a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:14 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 Jun 24 00:22:14 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Flow 'volume_create_manager' (35f40a9a-0637-4c7f-90f9-3e802905009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6730eb7-4f3a-4f21-af0a-c2d249893ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6730eb7-4f3a-4f21-af0a-c2d249893ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1487863449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933f2b67-ddd1-4661-975e-dc4b29c41d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dbab2e91c8481a80b6921927c27721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:14Z,use_quota=True,user_id='d329ab6a61a34b09a317454e3c023977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28a4e6c3-a792-4052-8153-082c0d28f221),volume_type_id=28a4e6c3-a792-4052-8153-082c0d28f221)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bc066a-f51f-4851-aad1-09504080a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bc066a-f51f-4851-aad1-09504080a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422467bd-114e-45eb-b3dd-82cfee5d1d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422467bd-114e-45eb-b3dd-82cfee5d1d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '933f2b67-ddd1-4661-975e-dc4b29c41d31', 'volume_name': 'volume-933f2b67-ddd1-4661-975e-dc4b29c41d31', 'volume_size': 1, 'image_id': 'f3e1aed7-733b-4589-92c1-9893c5e2773f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3e1aed7-733b-4589-92c1-9893c5e2773f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1897518081', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01dbab2e91c8481a80b6921927c27721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3e1aed7-733b-4589-92c1-9893c5e2773f', 'created_at': datetime.datetime(2026, 6, 23, 22, 22, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 22, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3e1aed7-733b-4589-92c1-9893c5e2773f/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82256444-c4e7-480c-927c-4cfc3783a194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82256444-c4e7-480c-927c-4cfc3783a194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08865c8f-934b-4817-8cfb-8a22622470eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Volume 933f2b67-ddd1-4661-975e-dc4b29c41d31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-933f2b67-ddd1-4661-975e-dc4b29c41d31', 'volume_size': 1, 'image_id': 'f3e1aed7-733b-4589-92c1-9893c5e2773f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3e1aed7-733b-4589-92c1-9893c5e2773f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1897518081', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01dbab2e91c8481a80b6921927c27721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3e1aed7-733b-4589-92c1-9893c5e2773f', 'created_at': datetime.datetime(2026, 6, 23, 22, 22, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 22, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3e1aed7-733b-4589-92c1-9893c5e2773f/file', 'properties': {}}, 'image_service': } Jun 24 00:22:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Trying to clone 933f2b67-ddd1-4661-975e-dc4b29c41d31 from image f3e1aed7-733b-4589-92c1-9893c5e2773f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f3e1aed7-733b-4589-92c1-9893c5e2773f', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:22:15 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 1G" returned: 0 in 1.042s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:15 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 Jun 24 00:22:15 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:15 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32" returned: 0 in 0.941s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:22:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df234e4-8974-4c20-b88e-faf8af7d33e8]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:15 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 Jun 24 00:22:15 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:16 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342" returned: 0 in 1.056s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:16 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:22:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:16 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 Jun 24 00:22:16 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:16 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" returned: 0 in 1.298s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:16 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 Jun 24 00:22:16 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:17 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342" returned: 0 in 1.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:17 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.info Jun 24 00:22:17 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:18 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32" returned: 0 in 1.491s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:18 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32 Jun 24 00:22:18 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:18 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.info" returned: 0 in 1.199s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:18 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:22:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:18 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.info Jun 24 00:22:18 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:19 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4.c2b7654f-acf9-4473-8efb-3b17526e3b32" returned: 0 in 1.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-quobyte-c2b7654f-acf9-4473-8efb-3b17526e3b32" released by "_delete_snapshot" :: held 5.184s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-quobyte-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" released by "delete_snapshot" :: held 5.214s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Created reservations ['7b85ba1f-2e44-4da0-9fce-d529275a210c', '6c32265a-310c-4c3e-8e93-246f41db744d', 'd2359fc0-bdba-4d97-bc6a-8c063c4f03b6', '2fa22710-d56c-44ab-ba4a-6dc8ff5f594c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:22:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Delete snapshot completed successfully. Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-293c1538-1639-4506-8248-6f9d556e86e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-c2b7654f-acf9-4473-8efb-3b17526e3b32-delete_snapshot" released by "delete_snapshot" :: held 5.434s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:19 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.info" returned: 0 in 1.037s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Acquiring lock "cinder-quobyte-4ce05729-75cb-4d7c-9de4-16a952cae639" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Lock "cinder-quobyte-4ce05729-75cb-4d7c-9de4-16a952cae639" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] snapshot: 29765350-dda4-4700-a490-4750fbdf5342, volume: 4ce05729-75cb-4d7c-9de4-16a952cae639, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1b9e89-8001-48f0-a70d-fbd39bd0e351]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:20 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 Jun 24 00:22:20 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD, size 20.69 MB, duration 5.63 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:22:20 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Image download 20.69 MB at 3.67 MB/s Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[13703014-539a-46d4-8b9a-98f292a049c1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:20 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD Jun 24 00:22:20 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "cinder-7e7fdef0-9016-4298-81d0-6d65afcdd7a4-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-7e7fdef0-9016-4298-81d0-6d65afcdd7a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "cinder-quobyte-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-quobyte-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9644a4c-0ef4-4f09-bc4a-e058924d23f8]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:20 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342" returned: 0 in 0.891s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ef659-208d-48a9-8c29-d96b116319c1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:20 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 Jun 24 00:22:20 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:20 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b Jun 24 00:22:20 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:21 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Temporary image f3e1aed7-733b-4589-92c1-9893c5e2773f is fetched for user d329ab6a61a34b09a317454e3c023977. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4355729-00e8-44e6-a97a-c3b56bc889ed]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:21 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD Jun 24 00:22:21 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:21 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b" returned: 0 in 0.835s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:21 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 Jun 24 00:22:21 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:21 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" returned: 0 in 0.925s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:21 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4 Jun 24 00:22:21 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:22 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD" returned: 0 in 0.850s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:22 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" returned: 0 in 0.718s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-quobyte-7e7fdef0-9016-4298-81d0-6d65afcdd7a4" released by "delete_volume" :: held 1.725s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Created reservations ['59e9f7e8-7165-427b-8cfd-a85ca0f20378', '4fd5048f-c591-408d-b08a-2e5e4c82ef20', '582a67cf-7f61-4819-874c-6b52e6115d70', '702fde79-580a-4b81-9da6-8f92fa933a3e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:22 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:22:22 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:24 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 2.045s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:22:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Deleted volume successfully. Jun 24 00:22:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c694eb1b-8b9a-43e8-a826-0ccefa57a219 tempest-VolumeSnapshotQuotasNegativeTestJSON-1366963982 None] Lock "cinder-7e7fdef0-9016-4298-81d0-6d65afcdd7a4-delete_volume" released by "delete_volume" :: held 4.268s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:28 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639" returned: 0 in 6.742s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a856ee82-94c6-4518-9fc6-390174a6a972]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:28 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b Jun 24 00:22:28 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:29 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b" returned: 0 in 1.127s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:29 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:22:29 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Converted 1024.00 MB image at 151.87 MB/s Jun 24 00:22:29 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 00:22:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:29 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 Jun 24 00:22:29 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:30 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639" returned: 0 in 0.780s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Lock "cinder-quobyte-4ce05729-75cb-4d7c-9de4-16a952cae639" released by "_copy_volume_from_snapshot" :: held 10.478s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Acquiring lock "cinder-quobyte-29765350-dda4-4700-a490-4750fbdf5342" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Lock "cinder-quobyte-29765350-dda4-4700-a490-4750fbdf5342" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Deleting offline snapshot 29765350-dda4-4700-a490-4750fbdf5342 of volume 2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:22:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] snapshot_file for this snap is: volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:22:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2790c63d-5af9-44f6-9ba8-0e62c39c7f53]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:30 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 Jun 24 00:22:30 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:31 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342" returned: 0 in 0.805s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:22:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe607b2-7b5c-470b-8756-53ec6f108fb2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:31 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b Jun 24 00:22:31 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:32 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b" returned: 0 in 0.794s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:32 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 Jun 24 00:22:32 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:32 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342" returned: 0 in 0.826s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:32 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342 Jun 24 00:22:32 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:33 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b.29765350-dda4-4700-a490-4750fbdf5342" returned: 0 in 0.633s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Lock "cinder-quobyte-29765350-dda4-4700-a490-4750fbdf5342" released by "_delete_snapshot" :: held 3.183s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.727s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.100s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-800103970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910a3af9-863a-4849-8bda-2a9b24eceac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dbab2e91c8481a80b6921927c27721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:13Z,use_quota=True,user_id='d329ab6a61a34b09a317454e3c023977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a198589c-bb1f-447a-92d2-58a851b700bb),volume_type_id=a198589c-bb1f-447a-92d2-58a851b700bb)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Creating volume 910a3af9-863a-4849-8bda-2a9b24eceac6 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:22:33 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:22:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:33 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 1073741824 Jun 24 00:22:33 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9d117613-1685-4a54-b432-3f1b231042dc tempest-GroupsV314Test-977145401 None] Create group from source-group-6026ca7a-74d1-4738-85cd-dc6b5f33f3d5 completed successfully. Jun 24 00:22:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Acquiring lock "cinder-quobyte-4ce05729-75cb-4d7c-9de4-16a952cae639" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Lock "cinder-quobyte-4ce05729-75cb-4d7c-9de4-16a952cae639" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d36fc9-d63e-4c6f-87fe-4571dedce10a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:34 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 Jun 24 00:22:34 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:34 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 1073741824" returned: 0 in 0.995s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:34 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 Jun 24 00:22:34 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:35 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639" returned: 0 in 0.834s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:35 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639 Jun 24 00:22:35 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:35 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6" returned: 0 in 0.802s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.537s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-447882540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b531bd9-badc-443e-9ed8-05e14ac79120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dbab2e91c8481a80b6921927c27721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:14Z,use_quota=True,user_id='d329ab6a61a34b09a317454e3c023977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7170dfb-9578-43ff-9ab7-1bcd0929fe62),volume_type_id=f7170dfb-9578-43ff-9ab7-1bcd0929fe62)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Creating volume 7b531bd9-badc-443e-9ed8-05e14ac79120 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:22:35 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6ddde1-9b5f-4984-8694-4dd3faac916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910a3af9-863a-4849-8bda-2a9b24eceac6', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:35 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 1073741824 Jun 24 00:22:35 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2272f026-0ce4-4f48-8ab0-a7634ed46179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Volume volume-910a3af9-863a-4849-8bda-2a9b24eceac6 (910a3af9-863a-4849-8bda-2a9b24eceac6): created successfully Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2272f026-0ce4-4f48-8ab0-a7634ed46179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Flow 'volume_create_manager' (a371d82e-454b-4751-8b75-f52093ec0a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8488490d-6915-44d7-b184-aea93f664ef5 tempest-TestInstancesWithCinderVolumes-799263952 None] Created volume successfully. Jun 24 00:22:35 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4ce05729-75cb-4d7c-9de4-16a952cae639" returned: 0 in 0.727s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Lock "cinder-quobyte-4ce05729-75cb-4d7c-9de4-16a952cae639" released by "delete_volume" :: held 1.617s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=76,cinder:INSERT=22,cinder:UPDATE=88,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Created reservations ['38618785-a323-40fb-b76b-5c6e6bcbbf94'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:22:36 devstack cinder-volume[94472]: WARNING cinder.quota [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1836964178 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1836964178, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:22:36 devstack cinder-volume[94472]: WARNING cinder.quota [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1836964178 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1836964178, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Created reservations ['16f75b54-c09f-447e-9445-6ace8500ad9f', 'f7c2d14a-0fbb-4cad-a7d5-9eb0ba94fd3b', 'e9eec1d7-0de6-493b-9557-96a41972eb4d', 'a6c9c9e4-d669-468b-9b50-811ecc2ab94a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:22:36 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:22:36 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Flow 'volume_create_manager' (f4bda4ee-c18e-41be-bdac-b887544a8ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94fea9f-449f-49d0-8948-89e1ed6e773e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94fea9f-449f-49d0-8948-89e1ed6e773e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1069194499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2d1ce9-075f-4de3-b12a-48594466befa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bafbf1cfecd9495baa7155b3efdede69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:36Z,use_quota=True,user_id='92ea35dd5db640e7942156a4e32dd8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e49d2-063a-452c-8d83-1272ae47fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e49d2-063a-452c-8d83-1272ae47fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0d1db7-cd64-424a-a1f0-5322d7648ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0d1db7-cd64-424a-a1f0-5322d7648ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2d1ce9-075f-4de3-b12a-48594466befa', 'volume_name': 'volume-bb2d1ce9-075f-4de3-b12a-48594466befa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df369bc-c491-4ab7-a224-07262d48315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df369bc-c491-4ab7-a224-07262d48315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cbe6af-ea7e-4a7e-9ecc-7ef1906288a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:36 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Volume bb2d1ce9-075f-4de3-b12a-48594466befa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2d1ce9-075f-4de3-b12a-48594466befa', 'volume_size': 1} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:36 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 1073741824" returned: 0 in 1.045s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:36 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 Jun 24 00:22:36 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Acquiring lock "cinder-quobyte-2aa398f1-d77f-419b-8a6b-e9309db0b51b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:37 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.831s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:22:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ff33568a-5123-403a-b889-df8258440178 tempest-GroupsV314Test-977145401 None] Delete group completed successfully. Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Lock "cinder-quobyte-2aa398f1-d77f-419b-8a6b-e9309db0b51b" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1025a8a9-b4d3-412f-a708-ad669da943af]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:37 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b Jun 24 00:22:37 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:37 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120" returned: 0 in 0.753s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1487863449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933f2b67-ddd1-4661-975e-dc4b29c41d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dbab2e91c8481a80b6921927c27721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:14Z,use_quota=True,user_id='d329ab6a61a34b09a317454e3c023977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28a4e6c3-a792-4052-8153-082c0d28f221),volume_type_id=28a4e6c3-a792-4052-8153-082c0d28f221)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Creating volume 933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:22:37 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7814c09-9207-40b9-9f4b-b723f877d54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b531bd9-badc-443e-9ed8-05e14ac79120', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:37 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 1073741824 Jun 24 00:22:37 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f63035-8bc1-40e4-9b60-a60e5603d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:37 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Volume volume-7b531bd9-badc-443e-9ed8-05e14ac79120 (7b531bd9-badc-443e-9ed8-05e14ac79120): created successfully Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f63035-8bc1-40e4-9b60-a60e5603d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Flow 'volume_create_manager' (cc5925ce-1a8b-4ed7-8b90-5127e0890d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6097ab0a-1f9b-457e-b063-02fda7d23ad4 tempest-TestInstancesWithCinderVolumes-799263952 None] Created volume successfully. Jun 24 00:22:38 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b" returned: 0 in 0.901s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:38 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b Jun 24 00:22:38 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:38 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 1073741824" returned: 0 in 0.833s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=86,cinder:INSERT=23,cinder:UPDATE=94,cinder:DELETE=7 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:38 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:22:38 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:38 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-2aa398f1-d77f-419b-8a6b-e9309db0b51b" returned: 0 in 0.691s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Lock "cinder-quobyte-2aa398f1-d77f-419b-8a6b-e9309db0b51b" released by "delete_volume" :: held 1.670s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Created reservations ['a430d804-e8cd-42b9-9cb5-b36dacdc47d1'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:22:38 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 0 in 0.631s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.507s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1069194499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2d1ce9-075f-4de3-b12a-48594466befa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bafbf1cfecd9495baa7155b3efdede69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:36Z,use_quota=True,user_id='92ea35dd5db640e7942156a4e32dd8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Creating volume bb2d1ce9-075f-4de3-b12a-48594466befa {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:22:38 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:38 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa 1073741824 Jun 24 00:22:38 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Attempting download of f3e1aed7-733b-4589-92c1-9893c5e2773f ((None, [{'url': 'file:///opt/stack/data/glance/images/f3e1aed7-733b-4589-92c1-9893c5e2773f', 'metadata': {}}])) to volume 933f2b67-ddd1-4661-975e-dc4b29c41d31. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Created reservations ['8fec4461-0ebf-4218-be19-8d9f17942616', 'f1d7164c-56bd-48a8-9a18-4627666bd6c6', 'b9ea580a-7775-4570-ad07-e2b319ef1624', '46662208-df9a-4a43-a9d1-44d10f43da19'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[346dc421-80be-4a62-aec9-c5028e042e21]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3e1aed7-733b-4589-92c1-9893c5e2773f_8e0bzjyj {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:39 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3e1aed7-733b-4589-92c1-9893c5e2773f_8e0bzjyj Jun 24 00:22:39 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:39 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:22:39 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:39 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:22:39 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:39 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3e1aed7-733b-4589-92c1-9893c5e2773f_8e0bzjyj" returned: 0 in 0.946s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3e1aed7-733b-4589-92c1-9893c5e2773f_8e0bzjyj {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:40 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.988s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:22:40 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3e1aed7-733b-4589-92c1-9893c5e2773f_8e0bzjyj Jun 24 00:22:40 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-acf1ca7b-2e0c-43a2-bf18-cdb58867db4a tempest-GroupsV314Test-977145401 None] Delete group completed successfully. Jun 24 00:22:40 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa 1073741824" returned: 0 in 1.302s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:40 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa Jun 24 00:22:40 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:40 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.051s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:22:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:22:41 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3e1aed7-733b-4589-92c1-9893c5e2773f_8e0bzjyj" returned: 1 in 1.079s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3e1aed7-733b-4589-92c1-9893c5e2773f_8e0bzjyj' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a6ccaf-4c0c-4768-8cd9-53d6de2f19e5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:41 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa" returned: 0 in 0.805s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cbe6af-ea7e-4a7e-9ecc-7ef1906288a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2d1ce9-075f-4de3-b12a-48594466befa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890aff7f-de71-4412-900f-d7d70c070950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Volume volume-bb2d1ce9-075f-4de3-b12a-48594466befa (bb2d1ce9-075f-4de3-b12a-48594466befa): created successfully Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890aff7f-de71-4412-900f-d7d70c070950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Flow 'volume_create_manager' (f4bda4ee-c18e-41be-bdac-b887544a8ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:41 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD Jun 24 00:22:41 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2a71778d-d539-4fef-9c08-21db29c18f64 tempest-VolumesTransfersV355Test-830263893 None] Created volume successfully. Jun 24 00:22:42 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD" returned: 0 in 1.343s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:42 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] f3e1aed7-733b-4589-92c1-9893c5e2773f was qcow2, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:22:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:42 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:22:42 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b399e107-f9a5-4756-be0b-ebb1cc079fe9 tempest-VolumesTransfersV355Test-1803586575 None] Transfer volume completed successfully. Jun 24 00:22:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Acquiring lock "cinder-bb2d1ce9-075f-4de3-b12a-48594466befa-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Lock "cinder-bb2d1ce9-075f-4de3-b12a-48594466befa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Acquiring lock "cinder-quobyte-bb2d1ce9-075f-4de3-b12a-48594466befa" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Lock "cinder-quobyte-bb2d1ce9-075f-4de3-b12a-48594466befa" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:44 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6d148b-8367-4019-b6ba-c083403c05be]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:44 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa Jun 24 00:22:44 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:45 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 0 in 2.753s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f3e1aed7-733b-4589-92c1-9893c5e2773f_603_akaydevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:22:45 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Converted 112.00 MB image at 40.66 MB/s Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:45 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 1G Jun 24 00:22:45 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:45 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa" returned: 0 in 0.857s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:45 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa Jun 24 00:22:45 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:45 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 1G" returned: 0 in 0.797s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:45 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bb2d1ce9-075f-4de3-b12a-48594466befa" returned: 0 in 0.716s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Lock "cinder-quobyte-bb2d1ce9-075f-4de3-b12a-48594466befa" released by "delete_volume" :: held 1.633s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af45c4-08b8-4896-9e3e-7d4e27a13e7b]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Created reservations ['06616c59-b8b1-49fe-9a3c-27412fe560e4', 'dc813158-42d0-4162-90c9-d55a6b517b5c', '9de58cc6-9c2c-437c-b00f-e86eaebe4bce', 'd349555c-cae2-4a1d-810d-2a402f8029ad'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:22:46 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:22:46 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:46 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:22:46 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:46 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 0 in 0.881s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:46 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.878s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:46 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:22:46 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:46 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:22:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Deleted volume successfully. Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-249dbda0-d9d7-4344-b182-77bf80bb23d7 tempest-VolumesTransfersV355Test-89619418 None] Lock "cinder-bb2d1ce9-075f-4de3-b12a-48594466befa-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Flow 'volume_create_manager' (db138f2f-d7e7-4727-850b-c104165d3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d1e03c-a0d5-4e16-91bf-fdae80d5d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d1e03c-a0d5-4e16-91bf-fdae80d5d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-868713625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9e3511-9623-444a-aab8-250f8719a3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bafbf1cfecd9495baa7155b3efdede69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:47Z,use_quota=True,user_id='92ea35dd5db640e7942156a4e32dd8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffb16b6-8601-4876-b7e7-40b1401eb068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffb16b6-8601-4876-b7e7-40b1401eb068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c945d77-3268-4730-95a4-3ea099911167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c945d77-3268-4730-95a4-3ea099911167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a9e3511-9623-444a-aab8-250f8719a3e3', 'volume_name': 'volume-3a9e3511-9623-444a-aab8-250f8719a3e3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc12cc4-b921-4e51-8dbb-d65fc8ab77fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc12cc4-b921-4e51-8dbb-d65fc8ab77fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaefb362-8147-400d-9adf-211e0a0a3b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:47 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Volume 3a9e3511-9623-444a-aab8-250f8719a3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a9e3511-9623-444a-aab8-250f8719a3e3', 'volume_size': 1} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-868713625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9e3511-9623-444a-aab8-250f8719a3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bafbf1cfecd9495baa7155b3efdede69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:22:47Z,use_quota=True,user_id='92ea35dd5db640e7942156a4e32dd8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Creating volume 3a9e3511-9623-444a-aab8-250f8719a3e3 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:22:47 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:47 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 1073741824 Jun 24 00:22:47 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:47 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 1 in 0.891s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Downloaded image f3e1aed7-733b-4589-92c1-9893c5e2773f ((None, [{'url': 'file:///opt/stack/data/glance/images/f3e1aed7-733b-4589-92c1-9893c5e2773f', 'metadata': {}}])) to volume 933f2b67-ddd1-4661-975e-dc4b29c41d31 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Temporary image f3e1aed7-733b-4589-92c1-9893c5e2773f for user d329ab6a61a34b09a317454e3c023977 is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Marking volume 933f2b67-ddd1-4661-975e-dc4b29c41d31 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Copying metadata from image f3e1aed7-733b-4589-92c1-9893c5e2773f to 933f2b67-ddd1-4661-975e-dc4b29c41d31. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Creating volume glance metadata for volume 933f2b67-ddd1-4661-975e-dc4b29c41d31 backed by image f3e1aed7-733b-4589-92c1-9893c5e2773f with: {'image_id': 'f3e1aed7-733b-4589-92c1-9893c5e2773f', 'image_name': 'tempest-scenario-img--1897518081', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08865c8f-934b-4817-8cfb-8a22622470eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933f2b67-ddd1-4661-975e-dc4b29c41d31', 'volume_size': 1, 'image_id': 'f3e1aed7-733b-4589-92c1-9893c5e2773f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3e1aed7-733b-4589-92c1-9893c5e2773f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1897518081', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01dbab2e91c8481a80b6921927c27721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3e1aed7-733b-4589-92c1-9893c5e2773f', 'created_at': datetime.datetime(2026, 6, 23, 22, 22, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 22, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3e1aed7-733b-4589-92c1-9893c5e2773f/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbae020-7bad-4d3f-a803-9d65cd4b2c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:47 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Volume volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 (933f2b67-ddd1-4661-975e-dc4b29c41d31): created successfully Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbae020-7bad-4d3f-a803-9d65cd4b2c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:47 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Flow 'volume_create_manager' (35f40a9a-0637-4c7f-90f9-3e802905009d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0be9ce81-5d74-4590-9842-f7684fea008d tempest-TestInstancesWithCinderVolumes-799263952 None] Created volume successfully. Jun 24 00:22:48 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 1073741824" returned: 0 in 1.010s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:48 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 Jun 24 00:22:48 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:49 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3" returned: 0 in 0.871s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:22:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaefb362-8147-400d-9adf-211e0a0a3b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a9e3511-9623-444a-aab8-250f8719a3e3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae689be8-cd05-4246-a16e-bb1dd3e2f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:22:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Volume volume-3a9e3511-9623-444a-aab8-250f8719a3e3 (3a9e3511-9623-444a-aab8-250f8719a3e3): created successfully Jun 24 00:22:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae689be8-cd05-4246-a16e-bb1dd3e2f65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:22:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Flow 'volume_create_manager' (db138f2f-d7e7-4727-850b-c104165d3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:22:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-81aa3e46-50f1-4b83-94f8-a0828b4766aa tempest-VolumesTransfersV355Test-830263893 None] Created volume successfully. Jun 24 00:22:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Acquiring lock "cinder-3a9e3511-9623-444a-aab8-250f8719a3e3-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Lock "cinder-3a9e3511-9623-444a-aab8-250f8719a3e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Acquiring lock "cinder-quobyte-3a9e3511-9623-444a-aab8-250f8719a3e3" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:22:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Lock "cinder-quobyte-3a9e3511-9623-444a-aab8-250f8719a3e3" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:22:51 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca2cffa-1616-44f0-a906-4d1b218ed9bd]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:51 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 Jun 24 00:22:51 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:52 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3" returned: 0 in 1.009s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:52 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3 Jun 24 00:22:52 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:52 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3a9e3511-9623-444a-aab8-250f8719a3e3" returned: 0 in 0.713s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Lock "cinder-quobyte-3a9e3511-9623-444a-aab8-250f8719a3e3" released by "delete_volume" :: held 1.800s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Created reservations ['3ecb1046-fafd-42b1-ad6b-9f4021db5551', '097eb51a-cf63-4650-9a87-458ff7880ff7', '5bc996b2-90fa-4281-ba9e-a27295280873', '9899d40c-3f71-434a-bfab-9ec05ae72cac'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:52 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:22:52 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:53 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.731s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:53 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:22:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Deleted volume successfully. Jun 24 00:22:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-88305df7-a98b-4618-b2ab-188ed5ceef49 tempest-VolumesTransfersV355Test-89619418 None] Lock "cinder-3a9e3511-9623-444a-aab8-250f8719a3e3-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:22:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:22:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:22:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c7e1fa-5b4b-45d2-ba7d-46bcfad0814b]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:22:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:55 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:22:55 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:56 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 0 in 1.063s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:22:56 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:22:56 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:22:57 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jun 24 00:22:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 1 in 1.097s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:22:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:22:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.224s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:22:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-933f2b67-ddd1-4661-975e-dc4b29c41d31', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ce37dc3-f795-4c00-8117-e22a9530a77e', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:22:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-f8c27612-7f4d-4538-a7bc-1fa75895b9f2 req-34e52324-928f-4873-afcd-327c7b3d0403 tempest-TestInstancesWithCinderVolumes-799263952 None] attachment_update completed successfully. Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Flow 'volume_create_manager' (7b04a55e-b9ea-4f90-a705-e7ed1f738a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bda226a-f4ee-4e0b-931e-eb3f3f95a876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bda226a-f4ee-4e0b-931e-eb3f3f95a876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-38715887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152a9a04-cc3f-419e-b56c-1e3d585a21cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6281a8996e4f50bdeb95d6a714567f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:04Z,use_quota=True,user_id='70dc5ccbc19142cdafd4a62f27130a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9567e5-cc4f-4ab6-b5e6-f3af7bfd2d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9567e5-cc4f-4ab6-b5e6-f3af7bfd2d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56b119b-3d23-49d4-96fc-ee20655f2736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56b119b-3d23-49d4-96fc-ee20655f2736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152a9a04-cc3f-419e-b56c-1e3d585a21cd', 'volume_name': 'volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5cfa08-b90d-4a33-b997-c8f945c768cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5cfa08-b90d-4a33-b997-c8f945c768cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd62aa4-d6ff-4d1b-b969-4a86162c0370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Volume 152a9a04-cc3f-419e-b56c-1e3d585a21cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd', 'volume_size': 1} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-38715887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152a9a04-cc3f-419e-b56c-1e3d585a21cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6281a8996e4f50bdeb95d6a714567f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:04Z,use_quota=True,user_id='70dc5ccbc19142cdafd4a62f27130a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Creating volume 152a9a04-cc3f-419e-b56c-1e3d585a21cd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:04 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:04 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd 1073741824 Jun 24 00:23:04 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Flow 'volume_create_manager' (c47c40ed-fc9b-42b8-a341-f0cc27deabf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179bfa82-c27b-4027-b05a-410f279bad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179bfa82-c27b-4027-b05a-410f279bad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-552593929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fce0d08b874effa0cc4b85e2649b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:04Z,use_quota=True,user_id='3ba2fed58fb34b3bbb2d3a9c3ba6d72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a463ab2f-cd0a-4858-9914-b178254ec122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a463ab2f-cd0a-4858-9914-b178254ec122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d4ac3f-7ded-4a21-9154-7992d4648079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d4ac3f-7ded-4a21-9154-7992d4648079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee', 'volume_name': 'volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48bd34b-9bf8-4156-8e61-4ac47f6f9819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48bd34b-9bf8-4156-8e61-4ac47f6f9819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7741e931-7b12-432e-be98-a179c69a1c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Volume bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee', 'volume_size': 1} Jun 24 00:23:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:05 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd 1073741824" returned: 0 in 0.860s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:05 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd Jun 24 00:23:05 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:05 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd" returned: 0 in 0.838s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.504s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-552593929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fce0d08b874effa0cc4b85e2649b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:04Z,use_quota=True,user_id='3ba2fed58fb34b3bbb2d3a9c3ba6d72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Creating volume bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:05 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:06 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee 1073741824 Jun 24 00:23:06 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd62aa4-d6ff-4d1b-b969-4a86162c0370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d741e6e6-a63e-48d8-b3d3-bae15d364517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Volume volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd (152a9a04-cc3f-419e-b56c-1e3d585a21cd): created successfully Jun 24 00:23:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d741e6e6-a63e-48d8-b3d3-bae15d364517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Flow 'volume_create_manager' (7b04a55e-b9ea-4f90-a705-e7ed1f738a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-54f2bc6f-3117-4174-ba64-00f92e70a9db tempest-VolumesTransfersV357Test-553984602 None] Created volume successfully. Jun 24 00:23:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-796fe537-f4c2-4af5-81ad-9051d6accc2e tempest-VolumesTransfersV357Test-1891587100 None] Transfer volume completed successfully. Jun 24 00:23:07 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee 1073741824" returned: 0 in 1.489s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:07 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee Jun 24 00:23:07 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:09 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee" returned: 0 in 1.837s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] <== create_volume: return (3389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.394s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7741e931-7b12-432e-be98-a179c69a1c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe9e9ca-b894-4a92-8181-32a0a7ff0f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Volume volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee (bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee): created successfully Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe9e9ca-b894-4a92-8181-32a0a7ff0f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Flow 'volume_create_manager' (c47c40ed-fc9b-42b8-a341-f0cc27deabf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-40a2a32c-1bcb-416d-b80d-ea24c0251df8 tempest-VolumesListAdminTestJSON-1051755831 None] Created volume successfully. Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Acquiring lock "cinder-152a9a04-cc3f-419e-b56c-1e3d585a21cd-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Lock "cinder-152a9a04-cc3f-419e-b56c-1e3d585a21cd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Acquiring lock "cinder-quobyte-152a9a04-cc3f-419e-b56c-1e3d585a21cd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Lock "cinder-quobyte-152a9a04-cc3f-419e-b56c-1e3d585a21cd" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef071322-0179-46ba-9d4a-931df751bdf9]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:10 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd Jun 24 00:23:10 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Flow 'volume_create_manager' (1158a588-b400-4a65-bf25-5d3fa5d22eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991a25f7-85d1-43ad-81bf-1c23d6813769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991a25f7-85d1-43ad-81bf-1c23d6813769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-924428561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac82a4c-1a38-4063-a455-132f380f7c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fce0d08b874effa0cc4b85e2649b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:12Z,use_quota=True,user_id='3ba2fed58fb34b3bbb2d3a9c3ba6d72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9a9fdd-3f33-49e8-bf52-f425570ebce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9a9fdd-3f33-49e8-bf52-f425570ebce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931b4d3a-9b5c-4056-853b-4abe887feb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931b4d3a-9b5c-4056-853b-4abe887feb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac82a4c-1a38-4063-a455-132f380f7c59', 'volume_name': 'volume-cac82a4c-1a38-4063-a455-132f380f7c59', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cf2d56-4b59-478b-8c64-040949bcad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cf2d56-4b59-478b-8c64-040949bcad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:11 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac01b267-1f47-4bcc-aaf6-de1534080bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Volume cac82a4c-1a38-4063-a455-132f380f7c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac82a4c-1a38-4063-a455-132f380f7c59', 'volume_size': 1} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-924428561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac82a4c-1a38-4063-a455-132f380f7c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fce0d08b874effa0cc4b85e2649b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:12Z,use_quota=True,user_id='3ba2fed58fb34b3bbb2d3a9c3ba6d72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Creating volume cac82a4c-1a38-4063-a455-132f380f7c59 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:11 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd" returned: 0 in 1.835s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:12 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 1073741824 Jun 24 00:23:12 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd Jun 24 00:23:12 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:12 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:13 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 1073741824" returned: 0 in 1.523s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:13 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-152a9a04-cc3f-419e-b56c-1e3d585a21cd" returned: 0 in 1.571s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:13 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 Jun 24 00:23:13 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Lock "cinder-quobyte-152a9a04-cc3f-419e-b56c-1e3d585a21cd" released by "delete_volume" :: held 3.575s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Created reservations ['ef10ed4d-86a3-4919-968a-712a16c30493', '7c4edc22-8588-41a9-839b-281c2d3f7a25', 'fc5685a9-8b83-443d-b8b5-740a70152a90', 'fd1f2aef-83b6-4a93-8aef-2d833ba20ab3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:14 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:14 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:15 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59" returned: 0 in 1.685s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] <== create_volume: return (3337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.345s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac01b267-1f47-4bcc-aaf6-de1534080bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac82a4c-1a38-4063-a455-132f380f7c59', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181a17be-4d10-43a3-b7b7-c5e3f37195a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Volume volume-cac82a4c-1a38-4063-a455-132f380f7c59 (cac82a4c-1a38-4063-a455-132f380f7c59): created successfully Jun 24 00:23:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181a17be-4d10-43a3-b7b7-c5e3f37195a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Flow 'volume_create_manager' (1158a588-b400-4a65-bf25-5d3fa5d22eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f4913438-9b48-4278-a9c2-1e8401a8bf73 tempest-VolumesListAdminTestJSON-1051755831 None] Created volume successfully. Jun 24 00:23:16 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 2.148s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Deleted volume successfully. Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8bcecdf1-f860-41df-95b3-b6e4e1dd39b6 tempest-VolumesTransfersV357Test-430569321 None] Lock "cinder-152a9a04-cc3f-419e-b56c-1e3d585a21cd-delete_volume" released by "delete_volume" :: held 6.259s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Flow 'volume_create_manager' (6c6f2c2c-6d26-4a20-862f-e26dc854ab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b903207-b3f1-4bf8-81e8-72bd8db23653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b903207-b3f1-4bf8-81e8-72bd8db23653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-81244533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09e2829-33ee-4c07-93f9-d2bfb4640e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6281a8996e4f50bdeb95d6a714567f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:16Z,use_quota=True,user_id='70dc5ccbc19142cdafd4a62f27130a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af707c61-f94b-41aa-9492-f1230dbf7aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af707c61-f94b-41aa-9492-f1230dbf7aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162e64ed-d724-43ef-bd70-32c037800c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162e64ed-d724-43ef-bd70-32c037800c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09e2829-33ee-4c07-93f9-d2bfb4640e64', 'volume_name': 'volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7c127b-1e6b-4101-b704-7fd187ea0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7c127b-1e6b-4101-b704-7fd187ea0306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431a60df-d136-4605-aa00-6bd5286b83d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Volume d09e2829-33ee-4c07-93f9-d2bfb4640e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64', 'volume_size': 1} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-81244533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09e2829-33ee-4c07-93f9-d2bfb4640e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6281a8996e4f50bdeb95d6a714567f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:16Z,use_quota=True,user_id='70dc5ccbc19142cdafd4a62f27130a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Creating volume d09e2829-33ee-4c07-93f9-d2bfb4640e64 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:16 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:16 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 1073741824 Jun 24 00:23:16 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Flow 'volume_create_manager' (2a67f975-dce5-4d6a-9df5-6c44d0c2cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15debbc8-a3b1-4be7-9f6d-65aaf4697567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15debbc8-a3b1-4be7-9f6d-65aaf4697567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-338327639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c5992e-1bfd-4b87-8276-60d4a169e97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fce0d08b874effa0cc4b85e2649b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:18Z,use_quota=True,user_id='3ba2fed58fb34b3bbb2d3a9c3ba6d72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105407c1-0eb2-4bfe-9d9f-426bc0ac88b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105407c1-0eb2-4bfe-9d9f-426bc0ac88b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c80ded-39f8-4404-a689-4dac162d4500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c80ded-39f8-4404-a689-4dac162d4500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c5992e-1bfd-4b87-8276-60d4a169e97c', 'volume_name': 'volume-22c5992e-1bfd-4b87-8276-60d4a169e97c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05c7f8a-4c62-402e-9113-2d60b8cec0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05c7f8a-4c62-402e-9113-2d60b8cec0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6081094e-0ca4-4820-ba7b-c6231913c1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Volume 22c5992e-1bfd-4b87-8276-60d4a169e97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c5992e-1bfd-4b87-8276-60d4a169e97c', 'volume_size': 1} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:18 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 1073741824" returned: 0 in 2.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:18 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 Jun 24 00:23:18 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64" returned: 0 in 0.971s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:19 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] <== create_volume: return (3304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.310s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-338327639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c5992e-1bfd-4b87-8276-60d4a169e97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fce0d08b874effa0cc4b85e2649b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:18Z,use_quota=True,user_id='3ba2fed58fb34b3bbb2d3a9c3ba6d72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Creating volume 22c5992e-1bfd-4b87-8276-60d4a169e97c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:19 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431a60df-d136-4605-aa00-6bd5286b83d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:19 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c 1073741824 Jun 24 00:23:19 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb33e2cf-a6e1-4340-87d4-00deb0493049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Volume volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 (d09e2829-33ee-4c07-93f9-d2bfb4640e64): created successfully Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb33e2cf-a6e1-4340-87d4-00deb0493049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Flow 'volume_create_manager' (6c6f2c2c-6d26-4a20-862f-e26dc854ab1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6360f615-39ac-4437-8e0f-7815256fcab8 tempest-VolumesTransfersV357Test-553984602 None] Created volume successfully. Jun 24 00:23:21 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c 1073741824" returned: 0 in 1.204s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Acquiring lock "cinder-d09e2829-33ee-4c07-93f9-d2bfb4640e64-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Lock "cinder-d09e2829-33ee-4c07-93f9-d2bfb4640e64-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:21 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c Jun 24 00:23:21 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Acquiring lock "cinder-quobyte-d09e2829-33ee-4c07-93f9-d2bfb4640e64" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Lock "cinder-quobyte-d09e2829-33ee-4c07-93f9-d2bfb4640e64" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf3167-1fb4-4d3f-bf6b-fd98fd726cb0]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:21 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 Jun 24 00:23:21 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:22 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64" returned: 0 in 1.358s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:22 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c" returned: 0 in 1.570s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] <== create_volume: return (2855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.859s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:22 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64 Jun 24 00:23:22 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6081094e-0ca4-4820-ba7b-c6231913c1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c5992e-1bfd-4b87-8276-60d4a169e97c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8bdbb3-172a-42bb-987f-31c9e983a496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Volume volume-22c5992e-1bfd-4b87-8276-60d4a169e97c (22c5992e-1bfd-4b87-8276-60d4a169e97c): created successfully Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8bdbb3-172a-42bb-987f-31c9e983a496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Flow 'volume_create_manager' (2a67f975-dce5-4d6a-9df5-6c44d0c2cba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-181010bd-bf29-47b5-8923-2feaeb42cd74 tempest-VolumesListAdminTestJSON-1051755831 None] Created volume successfully. Jun 24 00:23:23 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d09e2829-33ee-4c07-93f9-d2bfb4640e64" returned: 0 in 0.977s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Lock "cinder-quobyte-d09e2829-33ee-4c07-93f9-d2bfb4640e64" released by "delete_volume" :: held 2.453s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Created reservations ['a2cb33af-3edf-4881-9e11-251ec972dbca', '66d399a0-2574-487a-9b77-1500e0db1630', 'a51e1fda-d97d-479a-9074-0e6c934a65c0', '4303da58-6745-4e93-bfdf-7a1c85a01256'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:23 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:23 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Flow 'volume_create_manager' (2cf0b4b6-2b57-464d-8072-35c53a6e0d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225193a5-94c9-496d-83be-758d756ca8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225193a5-94c9-496d-83be-758d756ca8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da4bff1-1d25-425f-a775-eeb5ea25358c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af29ec6b64074cf38757a106f5c4c598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:24Z,use_quota=True,user_id='9dbaae3bc8ad4adfabf7811903045d69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d9072b-1945-46be-81ec-12dc41b411d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d9072b-1945-46be-81ec-12dc41b411d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcebf76-3e1e-4ac3-ac0b-4f4c5ae44c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcebf76-3e1e-4ac3-ac0b-4f4c5ae44c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da4bff1-1d25-425f-a775-eeb5ea25358c', 'volume_name': 'volume-0da4bff1-1d25-425f-a775-eeb5ea25358c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c1d25-92cb-483c-9313-08a1aad2c4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c1d25-92cb-483c-9313-08a1aad2c4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f00864-8f66-49c5-b6ac-b60957e0d034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Volume 0da4bff1-1d25-425f-a775-eeb5ea25358c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da4bff1-1d25-425f-a775-eeb5ea25358c', 'volume_size': 1} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da4bff1-1d25-425f-a775-eeb5ea25358c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af29ec6b64074cf38757a106f5c4c598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:24Z,use_quota=True,user_id='9dbaae3bc8ad4adfabf7811903045d69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Creating volume 0da4bff1-1d25-425f-a775-eeb5ea25358c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:24 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:24 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c 1073741824 Jun 24 00:23:24 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:24 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.976s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Deleted volume successfully. Jun 24 00:23:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-60f2fa34-0b89-44a3-9b2d-38e9dab65ef3 tempest-VolumesTransfersV357Test-430569321 None] Lock "cinder-d09e2829-33ee-4c07-93f9-d2bfb4640e64-delete_volume" released by "delete_volume" :: held 3.861s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:25 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c 1073741824" returned: 0 in 1.192s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:26 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c Jun 24 00:23:26 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:26 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c" returned: 0 in 0.853s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f00864-8f66-49c5-b6ac-b60957e0d034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da4bff1-1d25-425f-a775-eeb5ea25358c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a6c7f8-4137-4505-91e4-656ab5fa8b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Volume volume-0da4bff1-1d25-425f-a775-eeb5ea25358c (0da4bff1-1d25-425f-a775-eeb5ea25358c): created successfully Jun 24 00:23:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a6c7f8-4137-4505-91e4-656ab5fa8b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Flow 'volume_create_manager' (2cf0b4b6-2b57-464d-8072-35c53a6e0d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-908cbced-6ee9-420b-969c-97b6ae927a49 tempest-VolumesListAdminTestJSON-1813084018 None] Created volume successfully. Jun 24 00:23:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Acquiring lock "cinder-0da4bff1-1d25-425f-a775-eeb5ea25358c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "cinder-0da4bff1-1d25-425f-a775-eeb5ea25358c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Acquiring lock "cinder-quobyte-0da4bff1-1d25-425f-a775-eeb5ea25358c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "cinder-quobyte-0da4bff1-1d25-425f-a775-eeb5ea25358c" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7cbaa5-0b71-4ab0-bc1b-41abe1b11900]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "cinder-22c5992e-1bfd-4b87-8276-60d4a169e97c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-22c5992e-1bfd-4b87-8276-60d4a169e97c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "cinder-quobyte-22c5992e-1bfd-4b87-8276-60d4a169e97c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-quobyte-22c5992e-1bfd-4b87-8276-60d4a169e97c" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be2bdc8-c6b8-4490-a9e9-278712fa8cbd]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:28 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c Jun 24 00:23:28 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:28 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c Jun 24 00:23:28 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:29 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c" returned: 0 in 0.943s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:29 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c Jun 24 00:23:29 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:29 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c" returned: 0 in 1.033s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:29 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c Jun 24 00:23:29 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:29 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0da4bff1-1d25-425f-a775-eeb5ea25358c" returned: 0 in 0.770s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "cinder-quobyte-0da4bff1-1d25-425f-a775-eeb5ea25358c" released by "delete_volume" :: held 1.787s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Created reservations ['82f3e851-108a-4569-8144-fe6ae118812c', 'f65bdb7e-11ab-4fa3-9da4-4d372e2e91ae', '1bf98088-2aae-42ba-bc4b-395eea33489d', '6c6c3529-e78b-4db8-ae7a-752d9384fc1f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:30 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-22c5992e-1bfd-4b87-8276-60d4a169e97c" returned: 0 in 0.747s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:30 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:30 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-quobyte-22c5992e-1bfd-4b87-8276-60d4a169e97c" released by "delete_volume" :: held 1.834s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Created reservations ['999f2377-6693-41d2-8a7a-7376550d12c5', '1fb84c29-db82-407a-91b0-36f59feef9ba', '1663da30-92d3-4617-844d-3ddec01ec384', '2ddfb818-1f78-4f1d-ac42-82903ea8eca6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:30 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:30 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "cinder-cac82a4c-1a38-4063-a455-132f380f7c59-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-cac82a4c-1a38-4063-a455-132f380f7c59-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "cinder-quobyte-cac82a4c-1a38-4063-a455-132f380f7c59" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-quobyte-cac82a4c-1a38-4063-a455-132f380f7c59" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1587fb25-79b8-415e-9d94-695b4271652e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:30 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.736s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Deleted volume successfully. Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-eae2c3df-da42-4e17-8777-1fa7161906e9 tempest-VolumesListAdminTestJSON-1813084018 None] Lock "cinder-0da4bff1-1d25-425f-a775-eeb5ea25358c-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:30 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 Jun 24 00:23:30 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:30 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.740s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Deleted volume successfully. Jun 24 00:23:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a013c823-9c3d-434d-9aeb-36af42039ae4 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-22c5992e-1bfd-4b87-8276-60d4a169e97c-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:31 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59" returned: 0 in 0.862s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:31 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59 Jun 24 00:23:31 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Flow 'volume_create_manager' (d275d8e4-1792-4b6d-bfe2-234a3ea1ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d419fb-5a96-46ad-9d28-35b51a5816e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d419fb-5a96-46ad-9d28-35b51a5816e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1354277161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8970924a-8602-4f2a-a640-010310ed766c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac924a240b24bedb8abf3d5371ac33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:32Z,use_quota=True,user_id='86343b73317e4ba59fe6aa8d0172c654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9f9815-ab09-4fb0-a361-79caf51d1cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9f9815-ab09-4fb0-a361-79caf51d1cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77379fe9-746e-4018-8dc6-e1d7e97cb86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77379fe9-746e-4018-8dc6-e1d7e97cb86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8970924a-8602-4f2a-a640-010310ed766c', 'volume_name': 'volume-8970924a-8602-4f2a-a640-010310ed766c', 'volume_size': 2}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fdfbb1-c0ff-40db-bffb-2e104276170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fdfbb1-c0ff-40db-bffb-2e104276170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74f97c8-379c-444d-ab7d-955b63c3c522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:31 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Volume 8970924a-8602-4f2a-a640-010310ed766c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8970924a-8602-4f2a-a640-010310ed766c', 'volume_size': 2} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1354277161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8970924a-8602-4f2a-a640-010310ed766c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac924a240b24bedb8abf3d5371ac33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:32Z,use_quota=True,user_id='86343b73317e4ba59fe6aa8d0172c654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Creating volume 8970924a-8602-4f2a-a640-010310ed766c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:31 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c 2147483648 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:31 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c 2147483648 Jun 24 00:23:31 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:32 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cac82a4c-1a38-4063-a455-132f380f7c59" returned: 0 in 0.648s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-quobyte-cac82a4c-1a38-4063-a455-132f380f7c59" released by "delete_volume" :: held 1.555s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Created reservations ['5450c823-a145-426a-a52b-ab3cd3bce7c4', '6ed3cf65-1a86-42e7-b0ba-6038114c38d9', '9f65c85d-f5a5-41b9-a4ce-59b33e21bb0f', '9719adef-5157-45a3-973f-cb35aebd13ec'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:32 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:32 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:32 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c 2147483648" returned: 0 in 0.880s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:32 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c Jun 24 00:23:32 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "cinder-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "cinder-quobyte-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-quobyte-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8e8ee5-cc96-4f5d-9cab-29d54c9c8d45]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:32 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.677s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Deleted volume successfully. Jun 24 00:23:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb48ddc9-fa3c-45ff-8e11-a19ea7ac7d9e tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-cac82a4c-1a38-4063-a455-132f380f7c59-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:33 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee Jun 24 00:23:33 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:33 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c" returned: 0 in 0.642s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74f97c8-379c-444d-ab7d-955b63c3c522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8970924a-8602-4f2a-a640-010310ed766c', 'volume_size': 2}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d8bc09-3cd7-4932-95cc-414823d4f523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Volume volume-8970924a-8602-4f2a-a640-010310ed766c (8970924a-8602-4f2a-a640-010310ed766c): created successfully Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d8bc09-3cd7-4932-95cc-414823d4f523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Flow 'volume_create_manager' (d275d8e4-1792-4b6d-bfe2-234a3ea1ad76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f50ddc42-c008-4bf0-885f-f8f5dcdefc3f tempest-VolumesCloneNegativeTest-1542448071 None] Created volume successfully. Jun 24 00:23:33 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee" returned: 0 in 0.800s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:33 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee Jun 24 00:23:33 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Acquiring lock "cinder-8970924a-8602-4f2a-a640-010310ed766c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Lock "cinder-8970924a-8602-4f2a-a640-010310ed766c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Acquiring lock "cinder-quobyte-8970924a-8602-4f2a-a640-010310ed766c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Lock "cinder-quobyte-8970924a-8602-4f2a-a640-010310ed766c" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5bc8e9-d211-4e08-ad7b-5be1dbe3a436]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:34 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c Jun 24 00:23:34 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:34 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee" returned: 0 in 0.713s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-quobyte-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee" released by "delete_volume" :: held 1.554s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Created reservations ['8e6780e4-b538-4938-994a-8834575be097', 'd169d62f-7d44-4171-bcca-90254dddf0fb', '331d975f-6633-4577-b26a-8028fe3528ba', '7f3c6725-d86b-4e82-b2d6-d1776529b600'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:34 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:34 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:34 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c" returned: 0 in 0.793s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:34 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c Jun 24 00:23:34 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:35 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.739s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Deleted volume successfully. Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38a9258-58f9-4793-a794-973a01bcc8e1 tempest-VolumesListAdminTestJSON-1051755831 None] Lock "cinder-bcd8a4cc-2ee2-4fb3-ab24-4b07ee05bbee-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:35 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8970924a-8602-4f2a-a640-010310ed766c" returned: 0 in 0.792s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Lock "cinder-quobyte-8970924a-8602-4f2a-a640-010310ed766c" released by "delete_volume" :: held 1.647s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Created reservations ['689c217a-0d28-4e7c-a917-bde3415b8a3d', 'b2378113-c030-4330-892c-477088b6df60', '33f36704-cae1-466f-9da1-ea561236f5b3', '9f0befd7-2560-464b-b89f-af7aedfd5551'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:35 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:35 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:36 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.927s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:36 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Deleted volume successfully. Jun 24 00:23:36 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:INSERT=37,cinder:SELECT=93,cinder:UPDATE=118,cinder:DELETE=15 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:23:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5de92bd2-a6d4-455d-8fb6-082b3b791943 tempest-VolumesCloneNegativeTest-1542448071 None] Lock "cinder-8970924a-8602-4f2a-a640-010310ed766c-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Flow 'volume_create_manager' (0b756b9d-45b7-4248-8adb-a2918b04179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e294bc3-c97b-4134-8790-553d709c01eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e294bc3-c97b-4134-8790-553d709c01eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382077986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5379f801-c788-4467-bbbc-5780aa0eee32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda7f489dfcc4d98a61129d3f5f00690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:37Z,use_quota=True,user_id='54125bffbdcc465fbfc3e801e661e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10adc553-950b-4146-8ff3-569266109e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10adc553-950b-4146-8ff3-569266109e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b97f07-ef55-4332-9dfb-309cc3666e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b97f07-ef55-4332-9dfb-309cc3666e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5379f801-c788-4467-bbbc-5780aa0eee32', 'volume_name': 'volume-5379f801-c788-4467-bbbc-5780aa0eee32', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dc75ce-921c-40ed-b9cf-d9faa4c9a24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dc75ce-921c-40ed-b9cf-d9faa4c9a24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cbdffb-c032-4d0c-83b3-dab6daea6e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:37 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Volume 5379f801-c788-4467-bbbc-5780aa0eee32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5379f801-c788-4467-bbbc-5780aa0eee32', 'volume_size': 1} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382077986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5379f801-c788-4467-bbbc-5780aa0eee32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda7f489dfcc4d98a61129d3f5f00690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:37Z,use_quota=True,user_id='54125bffbdcc465fbfc3e801e661e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Creating volume 5379f801-c788-4467-bbbc-5780aa0eee32 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:37 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:37 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 1073741824 Jun 24 00:23:37 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:38 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 1073741824" returned: 0 in 1.282s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:38 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=125,cinder:SELECT=76,cinder:INSERT=25,cinder:DELETE=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:23:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:38 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 Jun 24 00:23:38 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:39 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32" returned: 0 in 0.680s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cbdffb-c032-4d0c-83b3-dab6daea6e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5379f801-c788-4467-bbbc-5780aa0eee32', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b267310-a531-4cbf-a5be-168a7923c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Volume volume-5379f801-c788-4467-bbbc-5780aa0eee32 (5379f801-c788-4467-bbbc-5780aa0eee32): created successfully Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b267310-a531-4cbf-a5be-168a7923c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Flow 'volume_create_manager' (0b756b9d-45b7-4248-8adb-a2918b04179c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ec876129-91b6-4b29-aa45-420fbb22c2d5 tempest-AttachVolumeTestJSON-952325414 None] Created volume successfully. Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:39 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:39 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Flow 'volume_create_manager' (cee2f38b-3433-422d-81b6-46066935b4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf0dcd8-0ee4-4fe2-84b0-b1617ae64958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf0dcd8-0ee4-4fe2-84b0-b1617ae64958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-829828064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf73beb7-b801-4517-8fb7-ce7663592252,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd7ed3d51c294e419f8953efed8f3d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:40Z,use_quota=True,user_id='ed0e5c0f27654b01893ae7193c9e0a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9b1175-e5c4-4c67-a0f9-cac299504fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9b1175-e5c4-4c67-a0f9-cac299504fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327a19c0-6b93-4876-83a7-36c7089a61ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327a19c0-6b93-4876-83a7-36c7089a61ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf73beb7-b801-4517-8fb7-ce7663592252', 'volume_name': 'volume-bf73beb7-b801-4517-8fb7-ce7663592252', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6150dc3-1d66-4976-8e68-03dc7b66e515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6150dc3-1d66-4976-8e68-03dc7b66e515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce52a9c9-33a0-410b-af3e-63380851a3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:40 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Volume bf73beb7-b801-4517-8fb7-ce7663592252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf73beb7-b801-4517-8fb7-ce7663592252', 'volume_size': 1} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-829828064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf73beb7-b801-4517-8fb7-ce7663592252,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd7ed3d51c294e419f8953efed8f3d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:40Z,use_quota=True,user_id='ed0e5c0f27654b01893ae7193c9e0a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Creating volume bf73beb7-b801-4517-8fb7-ce7663592252 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:40 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:40 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 1073741824 Jun 24 00:23:40 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:40 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.686s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Flow 'volume_create_manager' (2a2ac5f6-4dae-43c5-af5a-f82e2d539142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92066e25-a52e-489d-ab25-660b237ff252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92066e25-a52e-489d-ab25-660b237ff252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-181841632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6558b15-6120-4a45-b56e-19f54acac6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4838a986658494994cdd47668cbd41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:41Z,use_quota=True,user_id='f066adb3ede74bb99690d63272eca39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1764e82f-3dab-4055-a5cc-03fdd071a942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1764e82f-3dab-4055-a5cc-03fdd071a942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f8e15e-debf-40bc-b23a-5cd070929950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:40 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f8e15e-debf-40bc-b23a-5cd070929950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6558b15-6120-4a45-b56e-19f54acac6b2', 'volume_name': 'volume-d6558b15-6120-4a45-b56e-19f54acac6b2', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d76985-999c-4ab3-93d9-bcb1876a33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d76985-999c-4ab3-93d9-bcb1876a33a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430b98b8-e898-45dd-bb93-a77f9ccbc73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Volume d6558b15-6120-4a45-b56e-19f54acac6b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6558b15-6120-4a45-b56e-19f54acac6b2', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Trying to clone d6558b15-6120-4a45-b56e-19f54acac6b2 from image f57f6d67-fa39-4fca-b804-ab80f4171967 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:23:41 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 1073741824" returned: 0 in 0.937s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:41 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 Jun 24 00:23:41 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:23:41 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Image download 20.69 MB at 20.69 MB/s Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[014018de-5365-4902-98f0-1189f274e00b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:41 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD Jun 24 00:23:41 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:41 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252" returned: 0 in 0.670s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce52a9c9-33a0-410b-af3e-63380851a3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf73beb7-b801-4517-8fb7-ce7663592252', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6734d6fc-74c7-4812-87f3-55d68f9be418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Volume volume-bf73beb7-b801-4517-8fb7-ce7663592252 (bf73beb7-b801-4517-8fb7-ce7663592252): created successfully Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6734d6fc-74c7-4812-87f3-55d68f9be418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Flow 'volume_create_manager' (cee2f38b-3433-422d-81b6-46066935b4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-89588968-1841-45e7-a954-e40dc655d19b tempest-VolumesListTestJSON-961526492 None] Created volume successfully. Jun 24 00:23:42 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Temporary image f57f6d67-fa39-4fca-b804-ab80f4171967 is fetched for user f066adb3ede74bb99690d63272eca39b. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1818f992-fef5-4312-9d09-437230085469]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:42 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD Jun 24 00:23:42 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Flow 'volume_create_manager' (3d663455-ca87-4c27-88d9-28bd9f514467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f78c0e-0e75-4e93-ac8c-8226cda6153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f78c0e-0e75-4e93-ac8c-8226cda6153c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-193961815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6246858f-75d7-4341-af2a-39570dd3f406,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd7ed3d51c294e419f8953efed8f3d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:43Z,use_quota=True,user_id='ed0e5c0f27654b01893ae7193c9e0a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1b4465-dc1a-4207-b903-78ae9a56fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1b4465-dc1a-4207-b903-78ae9a56fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75c880a-42c1-4ccd-90ba-dc887bc3f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75c880a-42c1-4ccd-90ba-dc887bc3f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6246858f-75d7-4341-af2a-39570dd3f406', 'volume_name': 'volume-6246858f-75d7-4341-af2a-39570dd3f406', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32bdebb-b23f-47ad-864d-4c584e3814aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32bdebb-b23f-47ad-864d-4c584e3814aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce3b2df-ab87-4549-b215-880fe788438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Volume 6246858f-75d7-4341-af2a-39570dd3f406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6246858f-75d7-4341-af2a-39570dd3f406', 'volume_size': 1} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-193961815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6246858f-75d7-4341-af2a-39570dd3f406,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd7ed3d51c294e419f8953efed8f3d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:43Z,use_quota=True,user_id='ed0e5c0f27654b01893ae7193c9e0a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Creating volume 6246858f-75d7-4341-af2a-39570dd3f406 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:43 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:43 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD" returned: 0 in 0.872s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:43 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 1073741824 Jun 24 00:23:43 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f995d66a-3ad7-4cf9-a284-8ca81d37d7bb req-242b9d76-680a-4932-9b10-cd8e9b016ccf tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:43 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 1073741824" returned: 0 in 0.811s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:43 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 Jun 24 00:23:43 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:44 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406" returned: 0 in 0.614s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-181841632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6558b15-6120-4a45-b56e-19f54acac6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4838a986658494994cdd47668cbd41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:41Z,use_quota=True,user_id='f066adb3ede74bb99690d63272eca39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Creating volume d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:44 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:44 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 1073741824 Jun 24 00:23:44 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce3b2df-ab87-4549-b215-880fe788438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6246858f-75d7-4341-af2a-39570dd3f406', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb43ca9a-bc1b-47ce-a8c5-0a8c69fb207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Volume volume-6246858f-75d7-4341-af2a-39570dd3f406 (6246858f-75d7-4341-af2a-39570dd3f406): created successfully Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb43ca9a-bc1b-47ce-a8c5-0a8c69fb207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Flow 'volume_create_manager' (3d663455-ca87-4c27-88d9-28bd9f514467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-99106504-ad80-4876-805b-5f80d8a922b7 tempest-VolumesListTestJSON-961526492 None] Created volume successfully. Jun 24 00:23:45 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 1073741824" returned: 0 in 0.835s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:45 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 Jun 24 00:23:45 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Flow 'volume_create_manager' (498ded61-efc8-4ac3-9f53-1fd233a82dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486dc300-f8c8-419d-859e-eb8ca3df761c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486dc300-f8c8-419d-859e-eb8ca3df761c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-40876946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ce8027-76a0-4136-b485-bb4743162cb2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd7ed3d51c294e419f8953efed8f3d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:45Z,use_quota=True,user_id='ed0e5c0f27654b01893ae7193c9e0a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7ea6f7-ddf8-409b-9de6-d30946972ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7ea6f7-ddf8-409b-9de6-d30946972ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9461e3-e7c4-4e40-8c10-3b9d3b25b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9461e3-e7c4-4e40-8c10-3b9d3b25b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ce8027-76a0-4136-b485-bb4743162cb2', 'volume_name': 'volume-f2ce8027-76a0-4136-b485-bb4743162cb2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c306b6b-e27a-4e34-b542-ac366b54c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c306b6b-e27a-4e34-b542-ac366b54c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df36e8f6-f3a2-411f-b752-071f6f636f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:45 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Volume f2ce8027-76a0-4136-b485-bb4743162cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ce8027-76a0-4136-b485-bb4743162cb2', 'volume_size': 1} Jun 24 00:23:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:46 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2" returned: 0 in 0.660s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f995d66a-3ad7-4cf9-a284-8ca81d37d7bb req-242b9d76-680a-4932-9b10-cd8e9b016ccf tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.561s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f50e4a9-aa20-430e-a726-f7a7b5c53ac2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f995d66a-3ad7-4cf9-a284-8ca81d37d7bb req-242b9d76-680a-4932-9b10-cd8e9b016ccf tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Attempting download of f57f6d67-fa39-4fca-b804-ab80f4171967 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}])) to volume d6558b15-6120-4a45-b56e-19f54acac6b2. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc26809-9e26-47d1-a904-29c1284790e4]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_y4qfdrze {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:46 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 Jun 24 00:23:46 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:46 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_y4qfdrze Jun 24 00:23:46 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-edc1292a-d0ca-4a1d-90d6-7e53c89513f1 req-6776e8be-abf5-4e94-9234-4d28eb11593d tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:46 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f995d66a-3ad7-4cf9-a284-8ca81d37d7bb req-242b9d76-680a-4932-9b10-cd8e9b016ccf tempest-AttachVolumeTestJSON-952325414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32" returned: 0 in 0.818s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f995d66a-3ad7-4cf9-a284-8ca81d37d7bb req-242b9d76-680a-4932-9b10-cd8e9b016ccf tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-40876946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ce8027-76a0-4136-b485-bb4743162cb2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd7ed3d51c294e419f8953efed8f3d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:45Z,use_quota=True,user_id='ed0e5c0f27654b01893ae7193c9e0a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Creating volume f2ce8027-76a0-4136-b485-bb4743162cb2 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:46 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:46 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_y4qfdrze" returned: 0 in 0.775s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_y4qfdrze {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:46 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 1073741824 Jun 24 00:23:46 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-f995d66a-3ad7-4cf9-a284-8ca81d37d7bb req-242b9d76-680a-4932-9b10-cd8e9b016ccf tempest-AttachVolumeTestJSON-952325414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-5379f801-c788-4467-bbbc-5780aa0eee32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b46637f4-7417-4ce2-950c-bc02970a3740', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:23:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-f995d66a-3ad7-4cf9-a284-8ca81d37d7bb req-242b9d76-680a-4932-9b10-cd8e9b016ccf tempest-AttachVolumeTestJSON-952325414 None] attachment_update completed successfully. Jun 24 00:23:47 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_y4qfdrze Jun 24 00:23:47 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:47 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_y4qfdrze" returned: 1 in 0.817s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_y4qfdrze' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:23:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7734f16-1488-4eb0-9122-1d8b2d256a25]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:47 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 1073741824" returned: 0 in 0.940s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:47 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD Jun 24 00:23:47 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:47 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 Jun 24 00:23:47 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:48 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] f57f6d67-fa39-4fca-b804-ab80f4171967 was qcow2, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:48 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 Jun 24 00:23:48 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:48 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2" returned: 0 in 0.666s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-edc1292a-d0ca-4a1d-90d6-7e53c89513f1 req-6776e8be-abf5-4e94-9234-4d28eb11593d tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.031s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df36e8f6-f3a2-411f-b752-071f6f636f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ce8027-76a0-4136-b485-bb4743162cb2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4cbb1b-5c0c-4a6e-b79e-a100e5c37070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f79a66a-525a-4b77-af6a-1181e4a73b45]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-edc1292a-d0ca-4a1d-90d6-7e53c89513f1 req-6776e8be-abf5-4e94-9234-4d28eb11593d tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:48 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Volume volume-f2ce8027-76a0-4136-b485-bb4743162cb2 (f2ce8027-76a0-4136-b485-bb4743162cb2): created successfully Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4cbb1b-5c0c-4a6e-b79e-a100e5c37070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Flow 'volume_create_manager' (498ded61-efc8-4ac3-9f53-1fd233a82dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d22ca5da-7ce0-4046-a35d-20e3d3480499 tempest-VolumesListTestJSON-961526492 None] Created volume successfully. Jun 24 00:23:48 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 Jun 24 00:23:48 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:49 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-edc1292a-d0ca-4a1d-90d6-7e53c89513f1 req-6776e8be-abf5-4e94-9234-4d28eb11593d tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6" returned: 0 in 0.857s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-edc1292a-d0ca-4a1d-90d6-7e53c89513f1 req-6776e8be-abf5-4e94-9234-4d28eb11593d tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.890s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-edc1292a-d0ca-4a1d-90d6-7e53c89513f1 req-6776e8be-abf5-4e94-9234-4d28eb11593d tempest-TestInstancesWithCinderVolumes-799263952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-910a3af9-863a-4849-8bda-2a9b24eceac6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5584679-c730-4071-968b-f10e14ef9042', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:23:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-edc1292a-d0ca-4a1d-90d6-7e53c89513f1 req-6776e8be-abf5-4e94-9234-4d28eb11593d tempest-TestInstancesWithCinderVolumes-799263952 None] attachment_update completed successfully. Jun 24 00:23:50 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2" returned: 0 in 1.924s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:50 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_9mfx7pjhdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:23:50 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Converted 112.00 MB image at 58.18 MB/s Jun 24 00:23:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:50 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 1G Jun 24 00:23:50 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:51 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 1G" returned: 0 in 0.831s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf60fd-1db5-40fe-904b-9d0b98d82be3]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:51 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 Jun 24 00:23:51 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Flow 'volume_create_manager' (0e85118f-9238-41e5-9157-8e1b4a5018c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5da47aa-2b8b-4336-ba2b-6b9a459af413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5da47aa-2b8b-4336-ba2b-6b9a459af413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1333650433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3972641-57ab-428d-a4a2-d35d4e0dcbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda7f489dfcc4d98a61129d3f5f00690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:52Z,use_quota=True,user_id='54125bffbdcc465fbfc3e801e661e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be525df1-42b6-4563-9900-0346c1040c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be525df1-42b6-4563-9900-0346c1040c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd75391-5301-416c-9702-dbae565f9e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd75391-5301-416c-9702-dbae565f9e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3972641-57ab-428d-a4a2-d35d4e0dcbe8', 'volume_name': 'volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e31bd5c-089f-4043-ae96-32116b566922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e31bd5c-089f-4043-ae96-32116b566922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6921c43-b546-4ef5-aeb7-48d43c5e1daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Volume f3972641-57ab-428d-a4a2-d35d4e0dcbe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8', 'volume_size': 1} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1333650433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3972641-57ab-428d-a4a2-d35d4e0dcbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda7f489dfcc4d98a61129d3f5f00690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:23:52Z,use_quota=True,user_id='54125bffbdcc465fbfc3e801e661e593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Creating volume f3972641-57ab-428d-a4a2-d35d4e0dcbe8 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:23:52 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:52 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 1073741824 Jun 24 00:23:52 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "cinder-f2ce8027-76a0-4136-b485-bb4743162cb2-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:52 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-f2ce8027-76a0-4136-b485-bb4743162cb2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2" returned: 0 in 0.936s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "cinder-quobyte-f2ce8027-76a0-4136-b485-bb4743162cb2" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-quobyte-f2ce8027-76a0-4136-b485-bb4743162cb2" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6bd17a-a812-42e1-84bc-d92ebf77474d]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:52 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 Jun 24 00:23:52 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:52 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 Jun 24 00:23:52 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:52 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 1073741824" returned: 0 in 0.953s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:53 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 Jun 24 00:23:53 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:53 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2" returned: 1 in 0.868s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Downloaded image f57f6d67-fa39-4fca-b804-ab80f4171967 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}])) to volume d6558b15-6120-4a45-b56e-19f54acac6b2 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Temporary image f57f6d67-fa39-4fca-b804-ab80f4171967 for user f066adb3ede74bb99690d63272eca39b is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Marking volume d6558b15-6120-4a45-b56e-19f54acac6b2 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Copying metadata from image f57f6d67-fa39-4fca-b804-ab80f4171967 to d6558b15-6120-4a45-b56e-19f54acac6b2. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Creating volume glance metadata for volume d6558b15-6120-4a45-b56e-19f54acac6b2 backed by image f57f6d67-fa39-4fca-b804-ab80f4171967 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:23:53 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2" returned: 0 in 0.860s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:53 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2 Jun 24 00:23:53 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430b98b8-e898-45dd-bb93-a77f9ccbc73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6558b15-6120-4a45-b56e-19f54acac6b2', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc690ee-8bb0-4345-97d9-262a5a8ce430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Volume volume-d6558b15-6120-4a45-b56e-19f54acac6b2 (d6558b15-6120-4a45-b56e-19f54acac6b2): created successfully Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc690ee-8bb0-4345-97d9-262a5a8ce430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Flow 'volume_create_manager' (2a2ac5f6-4dae-43c5-af5a-f82e2d539142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f26fbcf0-657f-46bb-a2b4-6e410d894ad1 tempest-VolumesImageMetadata-1648220216 None] Created volume successfully. Jun 24 00:23:53 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8" returned: 0 in 0.707s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6921c43-b546-4ef5-aeb7-48d43c5e1daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c098ed-4c92-43b0-a013-7a080bfdf6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:23:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Volume volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 (f3972641-57ab-428d-a4a2-d35d4e0dcbe8): created successfully Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c098ed-4c92-43b0-a013-7a080bfdf6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Flow 'volume_create_manager' (0e85118f-9238-41e5-9157-8e1b4a5018c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:23:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-60ca62e8-46d0-41ee-935b-75afe8024a0c tempest-AttachVolumeTestJSON-952325414 None] Created volume successfully. Jun 24 00:23:53 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f2ce8027-76a0-4136-b485-bb4743162cb2" returned: 0 in 0.671s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-quobyte-f2ce8027-76a0-4136-b485-bb4743162cb2" released by "delete_volume" :: held 1.571s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Created reservations ['7a6832f0-9b85-4809-acb6-b568272d03f7', '0d8bd68d-770e-4f2d-b93e-0237f94563eb', '917f6df8-dde4-40b2-bade-f68e3edf85e5', 'fa2e8ee8-9fda-4a18-918b-8ac963bc3366'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:54 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:54 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "cinder-6246858f-75d7-4341-af2a-39570dd3f406-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-6246858f-75d7-4341-af2a-39570dd3f406-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Acquiring lock "cinder-d6558b15-6120-4a45-b56e-19f54acac6b2-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Lock "cinder-d6558b15-6120-4a45-b56e-19f54acac6b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "cinder-quobyte-6246858f-75d7-4341-af2a-39570dd3f406" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-quobyte-6246858f-75d7-4341-af2a-39570dd3f406" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f31e31a-b6e7-4f45-bd72-e0d1d18f4439]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Acquiring lock "cinder-quobyte-d6558b15-6120-4a45-b56e-19f54acac6b2" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Lock "cinder-quobyte-d6558b15-6120-4a45-b56e-19f54acac6b2" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:54 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.798s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Deleted volume successfully. Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-185dab5d-37f3-46e9-a5f1-1bc55d9fb0b2 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-f2ce8027-76a0-4136-b485-bb4743162cb2-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac8b6af-99d5-4090-a419-aefcccef32c3]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:54 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 Jun 24 00:23:54 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:54 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 Jun 24 00:23:54 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:55 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406" returned: 0 in 0.798s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:55 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406 Jun 24 00:23:55 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:55 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2" returned: 0 in 0.754s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:55 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 Jun 24 00:23:55 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:56 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6246858f-75d7-4341-af2a-39570dd3f406" returned: 0 in 0.696s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-quobyte-6246858f-75d7-4341-af2a-39570dd3f406" released by "delete_volume" :: held 1.561s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Created reservations ['2c16df00-3d8e-4333-b917-daff5500d54a', 'd6e6efff-065e-494a-86bf-f4fcd581def6', '79ccc203-ae13-402e-b3b3-f8bff99d60fc', 'b095715c-416b-4b70-9222-233a4b276d61'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:56 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2" returned: 1 in 0.814s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:56 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:56 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:56 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2 Jun 24 00:23:56 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "cinder-bf73beb7-b801-4517-8fb7-ce7663592252-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-bf73beb7-b801-4517-8fb7-ce7663592252-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "cinder-quobyte-bf73beb7-b801-4517-8fb7-ce7663592252" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:23:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-quobyte-bf73beb7-b801-4517-8fb7-ce7663592252" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ed4d5a-199b-4961-9153-878daaba26f9]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:57 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.770s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Deleted volume successfully. Jun 24 00:23:57 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 Jun 24 00:23:57 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d984bd85-e1fb-44e0-8589-195da4c4f242 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-6246858f-75d7-4341-af2a-39570dd3f406-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:57 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d6558b15-6120-4a45-b56e-19f54acac6b2" returned: 0 in 0.813s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0726fc57-0a52-4027-9aa0-b46e3749b015 req-f1fadfef-ef64-4ef5-840d-0b935e459bc1 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0726fc57-0a52-4027-9aa0-b46e3749b015 req-f1fadfef-ef64-4ef5-840d-0b935e459bc1 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Lock "cinder-quobyte-d6558b15-6120-4a45-b56e-19f54acac6b2" released by "delete_volume" :: held 2.475s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d612972c-0193-4f83-8fd2-7753aeb3e356]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-0726fc57-0a52-4027-9aa0-b46e3749b015 req-f1fadfef-ef64-4ef5-840d-0b935e459bc1 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Created reservations ['81a35d98-415f-4fca-aab8-2673bd143ed3', '3bd3082f-daaf-4750-a809-aa58587eed93', '93331a9d-e414-49b0-8250-f5e76f0d7394', '92c14c68-d869-407b-b296-22836110ab4a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:57 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 Jun 24 00:23:57 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:57 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:57 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-17be75f4-eaed-4429-ae8f-d8a0bf7295de req-3afd73ba-5f3d-441e-a11d-4dae14711b2a tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:58 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252" returned: 0 in 1.015s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:58 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252 Jun 24 00:23:58 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:58 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.763s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Deleted volume successfully. Jun 24 00:23:58 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721ec0fd-09c2-4768-82d4-65e5c7b993b5 tempest-VolumesImageMetadata-1648220216 None] Lock "cinder-d6558b15-6120-4a45-b56e-19f54acac6b2-delete_volume" released by "delete_volume" :: held 3.540s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-0726fc57-0a52-4027-9aa0-b46e3749b015 req-f1fadfef-ef64-4ef5-840d-0b935e459bc1 tempest-AttachVolumeTestJSON-952325414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8" returned: 0 in 0.943s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0726fc57-0a52-4027-9aa0-b46e3749b015 req-f1fadfef-ef64-4ef5-840d-0b935e459bc1 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-17be75f4-eaed-4429-ae8f-d8a0bf7295de req-3afd73ba-5f3d-441e-a11d-4dae14711b2a tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.194s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[45964356-93fc-4c4f-8232-74ec4f29fb68]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-17be75f4-eaed-4429-ae8f-d8a0bf7295de req-3afd73ba-5f3d-441e-a11d-4dae14711b2a tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-0726fc57-0a52-4027-9aa0-b46e3749b015 req-f1fadfef-ef64-4ef5-840d-0b935e459bc1 tempest-AttachVolumeTestJSON-952325414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1405e8f3-c1b4-4ea1-a374-2771bc5d8dbf', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:23:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-0726fc57-0a52-4027-9aa0-b46e3749b015 req-f1fadfef-ef64-4ef5-840d-0b935e459bc1 tempest-AttachVolumeTestJSON-952325414 None] attachment_update completed successfully. Jun 24 00:23:58 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 Jun 24 00:23:58 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:58 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bf73beb7-b801-4517-8fb7-ce7663592252" returned: 0 in 0.773s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-quobyte-bf73beb7-b801-4517-8fb7-ce7663592252" released by "delete_volume" :: held 1.853s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:23:58 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Created reservations ['5cae9473-7244-4d60-a81f-295940a3b418', 'fa8ce9f2-784f-4a2e-a456-a9dd0ca051ea', 'ce9580c5-fa23-4ff8-9683-064ed6ea020c', '34315d0e-0e13-444b-9a4a-a4300b4ec2d4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:23:59 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:23:59 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:23:59 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-17be75f4-eaed-4429-ae8f-d8a0bf7295de req-3afd73ba-5f3d-441e-a11d-4dae14711b2a tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120" returned: 0 in 0.920s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-17be75f4-eaed-4429-ae8f-d8a0bf7295de req-3afd73ba-5f3d-441e-a11d-4dae14711b2a tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.942s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-17be75f4-eaed-4429-ae8f-d8a0bf7295de req-3afd73ba-5f3d-441e-a11d-4dae14711b2a tempest-TestInstancesWithCinderVolumes-799263952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-7b531bd9-badc-443e-9ed8-05e14ac79120', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86529dc0-80be-4853-8cc5-cf7df004bff6', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:23:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-17be75f4-eaed-4429-ae8f-d8a0bf7295de req-3afd73ba-5f3d-441e-a11d-4dae14711b2a tempest-TestInstancesWithCinderVolumes-799263952 None] attachment_update completed successfully. Jun 24 00:23:59 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.747s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:23:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Deleted volume successfully. Jun 24 00:23:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ad4622f9-fe59-4257-90db-877afe94ad46 tempest-VolumesListTestJSON-961526492 None] Lock "cinder-bf73beb7-b801-4517-8fb7-ce7663592252-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Flow 'volume_create_manager' (9686bf29-9238-4ab3-8e65-c1a16fafa373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef88ea5-fcf8-4845-a910-0ee2a641f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef88ea5-fcf8-4845-a910-0ee2a641f069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-887015856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5e9632-af3e-497d-9616-5c49760c3d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d7fe426cbc4e41869c85fc8ed3767d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:01Z,use_quota=True,user_id='f1a56b0489b84234ae70bf9e0dfe2b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c2f051-abf7-4eae-a9e7-df44dc202f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c2f051-abf7-4eae-a9e7-df44dc202f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c8fae8-0007-4217-a816-a809f5861d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c8fae8-0007-4217-a816-a809f5861d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5e9632-af3e-497d-9616-5c49760c3d1d', 'volume_name': 'volume-4f5e9632-af3e-497d-9616-5c49760c3d1d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5e88b9-3781-48c6-a03a-6cf1cc29a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5e88b9-3781-48c6-a03a-6cf1cc29a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce8fa37-c456-42aa-9d51-765ae8193b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:01 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Volume 4f5e9632-af3e-497d-9616-5c49760c3d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5e9632-af3e-497d-9616-5c49760c3d1d', 'volume_size': 1} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-887015856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5e9632-af3e-497d-9616-5c49760c3d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d7fe426cbc4e41869c85fc8ed3767d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:01Z,use_quota=True,user_id='f1a56b0489b84234ae70bf9e0dfe2b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Creating volume 4f5e9632-af3e-497d-9616-5c49760c3d1d {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:24:01 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:24:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:01 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d 1073741824 Jun 24 00:24:01 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:02 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d 1073741824" returned: 0 in 0.954s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:02 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d Jun 24 00:24:02 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:03 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d" returned: 0 in 0.713s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce8fa37-c456-42aa-9d51-765ae8193b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5e9632-af3e-497d-9616-5c49760c3d1d', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ac0058-99e1-4678-96dc-ecf8465cd645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Volume volume-4f5e9632-af3e-497d-9616-5c49760c3d1d (4f5e9632-af3e-497d-9616-5c49760c3d1d): created successfully Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ac0058-99e1-4678-96dc-ecf8465cd645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Flow 'volume_create_manager' (9686bf29-9238-4ab3-8e65-c1a16fafa373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1a7e8285-b723-4a46-b58c-47ab34a3f22f tempest-SnapshotMetadataTestJSON-280696383 None] Created volume successfully. Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Flow 'volume_create_manager' (d99fefd2-43f8-4a0d-8bb2-7c1137b1bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5289e9ec-6a3a-4ca5-b9ef-280329f0b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5289e9ec-6a3a-4ca5-b9ef-280329f0b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1155731131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f53333f-e327-4ef6-b2af-25b87f0ee36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a3a21eb0274476b6a8e5a02f163f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:04Z,use_quota=True,user_id='22d23125763d43e2a4121a4b7c10a12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9dfd2d-0649-4a2e-b3ef-5751a367812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9dfd2d-0649-4a2e-b3ef-5751a367812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f736bc-72cf-433c-8f8a-61e0626139dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f736bc-72cf-433c-8f8a-61e0626139dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f53333f-e327-4ef6-b2af-25b87f0ee36c', 'volume_name': 'volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c', 'volume_size': 2}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44309d1-6339-40d5-ab86-b676db132c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44309d1-6339-40d5-ab86-b676db132c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c806b95-1e6c-47fc-a946-123713c8b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Volume 1f53333f-e327-4ef6-b2af-25b87f0ee36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c', 'volume_size': 2} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1155731131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f53333f-e327-4ef6-b2af-25b87f0ee36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a3a21eb0274476b6a8e5a02f163f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:04Z,use_quota=True,user_id='22d23125763d43e2a4121a4b7c10a12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Creating volume 1f53333f-e327-4ef6-b2af-25b87f0ee36c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:24:03 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c 2147483648 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:03 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c 2147483648 Jun 24 00:24:03 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:04 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c 2147483648" returned: 0 in 1.139s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:05 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c Jun 24 00:24:05 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c" returned: 0 in 0.669s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:05 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.779s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c806b95-1e6c-47fc-a946-123713c8b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c', 'volume_size': 2}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc794475-0ec3-478b-a209-13096a6f6c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Creating offline snapshot f8fba559-d0c7-4ce8-a902-5088a392ef21 of volume 4f5e9632-af3e-497d-9616-5c49760c3d1d {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:24:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Volume volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c (1f53333f-e327-4ef6-b2af-25b87f0ee36c): created successfully Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc794475-0ec3-478b-a209-13096a6f6c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Flow 'volume_create_manager' (d99fefd2-43f8-4a0d-8bb2-7c1137b1bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6849e04b-21c6-4b0d-9095-6db73b962f14]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-39158588-e999-40f4-b251-71310f9ad3e9 req-9981b0d3-524b-40c0-aa85-1b2389b09008 tempest-AttachVolumeTestJSON-952325414 None] Terminate volume connection completed successfully. Jun 24 00:24:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-39158588-e999-40f4-b251-71310f9ad3e9 req-9981b0d3-524b-40c0-aa85-1b2389b09008 tempest-AttachVolumeTestJSON-952325414 None] Deleting attachment b46637f4-7417-4ce2-950c-bc02970a3740. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:24:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-26c0b58c-68e2-4b76-9c48-b2db91c50add tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Created volume successfully. Jun 24 00:24:05 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d Jun 24 00:24:05 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:06 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d" returned: 0 in 0.895s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:06 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 1G Jun 24 00:24:06 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:07 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 1G" returned: 0 in 0.888s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5e9632-af3e-497d-9616-5c49760c3d1d -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:07 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5e9632-af3e-497d-9616-5c49760c3d1d -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 Jun 24 00:24:07 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-bd15c9c8-9e8e-4280-8b7f-99600c87027e req-33816301-4899-4f3c-b7ec-874f7a3589ba tempest-AttachVolumeTestJSON-952325414 None] Terminate volume connection completed successfully. Jun 24 00:24:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bd15c9c8-9e8e-4280-8b7f-99600c87027e req-33816301-4899-4f3c-b7ec-874f7a3589ba tempest-AttachVolumeTestJSON-952325414 None] Deleting attachment 1405e8f3-c1b4-4ea1-a374-2771bc5d8dbf. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:24:08 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5e9632-af3e-497d-9616-5c49760c3d1d -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21" returned: 0 in 0.754s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:08 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 is being set with open permissions: ugo+rw Jun 24 00:24:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:08 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 Jun 24 00:24:08 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-66dbc3e2-ff01-4e4f-bee1-52904bcb0654 req-6bc42839-d1bb-4afc-839c-b429b41a330a tempest-TestInstancesWithCinderVolumes-799263952 None] Terminate volume connection completed successfully. Jun 24 00:24:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-66dbc3e2-ff01-4e4f-bee1-52904bcb0654 req-6bc42839-d1bb-4afc-839c-b429b41a330a tempest-TestInstancesWithCinderVolumes-799263952 None] Deleting attachment d5584679-c730-4071-968b-f10e14ef9042. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:24:09 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21" returned: 0 in 0.686s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:09 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.info Jun 24 00:24:09 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:09 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.info" returned: 0 in 0.695s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:09 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.info is being set with open permissions: ugo+rw Jun 24 00:24:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:09 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.info Jun 24 00:24:09 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:10 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.info" returned: 0 in 0.707s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.452s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Creating offline snapshot dd44e0cc-91f3-4947-853c-de2df5c23d52 of volume 1f53333f-e327-4ef6-b2af-25b87f0ee36c {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:24:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-99644ceb-2366-4f86-b1ad-e6d9ec48d869 tempest-SnapshotMetadataTestJSON-280696383 None] Create snapshot completed successfully Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed2059-3167-419c-bf4c-a9edfec85395]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "cinder-910a3af9-863a-4849-8bda-2a9b24eceac6-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-910a3af9-863a-4849-8bda-2a9b24eceac6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "cinder-quobyte-910a3af9-863a-4849-8bda-2a9b24eceac6" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:10 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c Jun 24 00:24:10 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-quobyte-910a3af9-863a-4849-8bda-2a9b24eceac6" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8180774c-9022-49c6-8fa4-aa5ed2093c17]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:10 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 Jun 24 00:24:10 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:11 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c" returned: 0 in 1.063s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 2G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:11 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 2G Jun 24 00:24:11 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:12 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6" returned: 0 in 1.201s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:12 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6 Jun 24 00:24:12 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "cinder-f8fba559-d0c7-4ce8-a902-5088a392ef21-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-f8fba559-d0c7-4ce8-a902-5088a392ef21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "cinder-quobyte-4f5e9632-af3e-497d-9616-5c49760c3d1d" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-quobyte-4f5e9632-af3e-497d-9616-5c49760c3d1d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "cinder-quobyte-f8fba559-d0c7-4ce8-a902-5088a392ef21" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-quobyte-f8fba559-d0c7-4ce8-a902-5088a392ef21" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Deleting offline snapshot f8fba559-d0c7-4ce8-a902-5088a392ef21 of volume 4f5e9632-af3e-497d-9616-5c49760c3d1d {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] snapshot_file for this snap is: volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[20252350-32ff-40e5-8931-5dc746bf9902]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:12 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-910a3af9-863a-4849-8bda-2a9b24eceac6" returned: 0 in 0.906s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-quobyte-910a3af9-863a-4849-8bda-2a9b24eceac6" released by "delete_volume" :: held 2.164s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:13 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 Jun 24 00:24:13 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:13 devstack cinder-volume[94472]: WARNING cinder.quota [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1892413626-1232387266 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1892413626-1232387266, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:24:13 devstack cinder-volume[94472]: WARNING cinder.quota [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1892413626-1232387266 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1892413626-1232387266, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Created reservations ['be21b285-7112-4eca-9e9d-62cde160c3c2', 'aaae0c04-7dba-4823-b3f0-917c70236d8d', '5060dd8b-e729-4b59-aa9f-441e0cc6b17c', '356ed7bc-6610-45c4-b802-860db0dbddd9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:13 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:13 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:13 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 2G" returned: 0 in 1.738s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:13 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 Jun 24 00:24:13 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:13 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21" returned: 0 in 1.174s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f5e9632-af3e-497d-9616-5c49760c3d1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:24:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdacf29b-7100-492d-a0aa-97827efcb722]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:14 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.007s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Deleted volume successfully. Jun 24 00:24:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d31d415a-a164-48bc-84d3-3d9a971b60fc tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-910a3af9-863a-4849-8bda-2a9b24eceac6-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:14 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d Jun 24 00:24:14 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:14 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52" returned: 0 in 1.063s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:14 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 is being set with open permissions: ugo+rw Jun 24 00:24:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:14 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 Jun 24 00:24:14 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:15 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d" returned: 0 in 1.089s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:15 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 Jun 24 00:24:15 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:15 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52" returned: 0 in 0.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:15 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.info Jun 24 00:24:15 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:16 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21" returned: 0 in 0.945s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:16 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21 Jun 24 00:24:16 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:16 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.info" returned: 0 in 0.786s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:16 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.info is being set with open permissions: ugo+rw Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:16 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.info Jun 24 00:24:16 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:16 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d.f8fba559-d0c7-4ce8-a902-5088a392ef21" returned: 0 in 0.781s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-quobyte-f8fba559-d0c7-4ce8-a902-5088a392ef21" released by "_delete_snapshot" :: held 4.173s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-quobyte-4f5e9632-af3e-497d-9616-5c49760c3d1d" released by "delete_snapshot" :: held 4.213s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:16 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.info" returned: 0 in 0.787s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.420s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Created reservations ['457ff101-2b25-4877-b3ff-515c70f66e15', '3dbe4061-93ac-43e0-ac2d-0354588fb156', '0f0525bf-a3e9-4a72-bfc8-a5c61a1e1be9', '02efac0c-ce41-4079-80fc-b97e4a212a17'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-10d132c2-3f03-4e86-b238-e289cda6f2d8 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Create snapshot completed successfully Jun 24 00:24:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-ed639eac-3308-4f71-a3b0-cf85efb96402 req-e70c5c25-310b-4641-8d30-7527f998fa9c tempest-TestInstancesWithCinderVolumes-799263952 None] Terminate volume connection completed successfully. Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-ed639eac-3308-4f71-a3b0-cf85efb96402 req-e70c5c25-310b-4641-8d30-7527f998fa9c tempest-TestInstancesWithCinderVolumes-799263952 None] Deleting attachment 86529dc0-80be-4853-8cc5-cf7df004bff6. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:24:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Delete snapshot completed successfully. Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e90733d2-68e9-4c68-8ce5-e3785188faf3 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-f8fba559-d0c7-4ce8-a902-5088a392ef21-delete_snapshot" released by "delete_snapshot" :: held 4.450s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "cinder-dd44e0cc-91f3-4947-853c-de2df5c23d52-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-dd44e0cc-91f3-4947-853c-de2df5c23d52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "cinder-quobyte-1f53333f-e327-4ef6-b2af-25b87f0ee36c" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-quobyte-1f53333f-e327-4ef6-b2af-25b87f0ee36c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "cinder-quobyte-dd44e0cc-91f3-4947-853c-de2df5c23d52" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-quobyte-dd44e0cc-91f3-4947-853c-de2df5c23d52" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Deleting offline snapshot dd44e0cc-91f3-4947-853c-de2df5c23d52 of volume 1f53333f-e327-4ef6-b2af-25b87f0ee36c {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] snapshot_file for this snap is: volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50e43dc-8942-4dbc-ad88-037f2e7bb8e5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:18 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 Jun 24 00:24:18 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "cinder-4f5e9632-af3e-497d-9616-5c49760c3d1d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-4f5e9632-af3e-497d-9616-5c49760c3d1d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "cinder-quobyte-4f5e9632-af3e-497d-9616-5c49760c3d1d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-quobyte-4f5e9632-af3e-497d-9616-5c49760c3d1d" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[73222c2c-ff98-4113-b435-24743043de44]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:18 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d Jun 24 00:24:18 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:18 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52" returned: 0 in 0.917s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f937a-cc72-49cf-8511-8cbb14b8aea1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "cinder-7b531bd9-badc-443e-9ed8-05e14ac79120-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-7b531bd9-badc-443e-9ed8-05e14ac79120-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:18 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c Jun 24 00:24:19 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "cinder-quobyte-7b531bd9-badc-443e-9ed8-05e14ac79120" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-quobyte-7b531bd9-badc-443e-9ed8-05e14ac79120" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec4b753-bb15-4000-a0e9-17b0ac71f6c4]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:19 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 Jun 24 00:24:19 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:19 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d" returned: 0 in 1.033s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:19 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d Jun 24 00:24:19 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:19 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c" returned: 0 in 1.115s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:20 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 Jun 24 00:24:20 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:20 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120" returned: 0 in 1.183s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "cinder-f3972641-57ab-428d-a4a2-d35d4e0dcbe8-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:20 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120 Jun 24 00:24:20 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-f3972641-57ab-428d-a4a2-d35d4e0dcbe8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:20 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-4f5e9632-af3e-497d-9616-5c49760c3d1d" returned: 0 in 1.097s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "cinder-quobyte-f3972641-57ab-428d-a4a2-d35d4e0dcbe8" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-quobyte-4f5e9632-af3e-497d-9616-5c49760c3d1d" released by "delete_volume" :: held 2.213s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-quobyte-f3972641-57ab-428d-a4a2-d35d4e0dcbe8" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ef9cc6-005b-4108-ab1b-3c049adc0cbc]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Created reservations ['d4909dca-b59e-4cb9-bdb7-683c0f1a33cb', 'cff53280-4b87-4648-9ba5-d5c42466670f', '3d7a160c-8756-41b0-963b-a4118902848e', '74a916e1-eda6-4833-99c0-b218ea367512'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:20 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 Jun 24 00:24:20 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:20 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:20 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:21 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52" returned: 0 in 1.294s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:21 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52 Jun 24 00:24:21 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:21 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7b531bd9-badc-443e-9ed8-05e14ac79120" returned: 0 in 1.272s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-quobyte-7b531bd9-badc-443e-9ed8-05e14ac79120" released by "delete_volume" :: held 2.510s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:21 devstack cinder-volume[94472]: WARNING cinder.quota [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1026491197-1532764799 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1026491197-1532764799, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:24:21 devstack cinder-volume[94472]: WARNING cinder.quota [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1026491197-1532764799 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1026491197-1532764799, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Created reservations ['132954dc-b7c4-406e-8f9a-6424a7d27aff', 'cf12cd4c-4571-4490-aaa8-d7318943a45d', 'ad274354-b53c-46cd-98ae-8edfed186358', '7f06104e-394d-4057-a660-0e2b2d297563'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:21 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:21 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:21 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.201s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:21 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8" returned: 0 in 1.395s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Deleted volume successfully. Jun 24 00:24:22 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8 Jun 24 00:24:22 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a58dffe2-b9b9-45a3-9f94-609b23bf26a9 tempest-SnapshotMetadataTestJSON-280696383 None] Lock "cinder-4f5e9632-af3e-497d-9616-5c49760c3d1d-delete_volume" released by "delete_volume" :: held 3.847s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:22 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c.dd44e0cc-91f3-4947-853c-de2df5c23d52" returned: 0 in 1.324s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-quobyte-dd44e0cc-91f3-4947-853c-de2df5c23d52" released by "_delete_snapshot" :: held 4.851s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-quobyte-1f53333f-e327-4ef6-b2af-25b87f0ee36c" released by "delete_snapshot" :: held 4.889s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Created reservations ['1f87ab97-3ce7-4f14-87b1-37f529df4854', '0bca57d5-2b93-4a33-82fb-3843d2b4a1f6', '99373b10-29db-4b94-9d4f-73a8924754c3', 'ebcb5e2f-26d3-4a6a-9bcd-5a9c39a94f88'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Delete snapshot completed successfully. Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bb6ee8b0-c9d6-4dc4-a273-5bf7eea3e914 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-dd44e0cc-91f3-4947-853c-de2df5c23d52-delete_snapshot" released by "delete_snapshot" :: held 5.260s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:23 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f3972641-57ab-428d-a4a2-d35d4e0dcbe8" returned: 0 in 1.162s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-quobyte-f3972641-57ab-428d-a4a2-d35d4e0dcbe8" released by "delete_volume" :: held 2.626s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Created reservations ['225f27a5-5318-4d40-9427-ba382316342d', 'e20ab236-2f90-4c9f-adc7-75e865baa624', 'd4e9df4e-9696-4ce0-a0b3-ada4940dccf0', '9f0fab22-4cf8-41fc-bcc2-8146c253cd84'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:23 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.471s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Deleted volume successfully. Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:23 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:23 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "cinder-1f53333f-e327-4ef6-b2af-25b87f0ee36c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6c592505-8ca9-4cdb-9a21-ee56a606ff77 tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-7b531bd9-badc-443e-9ed8-05e14ac79120-delete_volume" released by "delete_volume" :: held 4.452s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-1f53333f-e327-4ef6-b2af-25b87f0ee36c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "cinder-quobyte-1f53333f-e327-4ef6-b2af-25b87f0ee36c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-quobyte-1f53333f-e327-4ef6-b2af-25b87f0ee36c" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c014f6a-0a70-4365-868c-f39e40c9572a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:23 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c Jun 24 00:24:23 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "cinder-5379f801-c788-4467-bbbc-5780aa0eee32-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-5379f801-c788-4467-bbbc-5780aa0eee32-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "cinder-quobyte-5379f801-c788-4467-bbbc-5780aa0eee32" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-quobyte-5379f801-c788-4467-bbbc-5780aa0eee32" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[03feeaaf-a0f0-4bf9-917c-4596a7488990]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:24 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 Jun 24 00:24:24 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:24 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.177s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Deleted volume successfully. Jun 24 00:24:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-171a0f4e-d4a7-4108-aa5f-1015f1b22e0f tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-f3972641-57ab-428d-a4a2-d35d4e0dcbe8-delete_volume" released by "delete_volume" :: held 4.249s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:25 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c" returned: 0 in 1.467s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:25 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c Jun 24 00:24:25 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:26 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32" returned: 0 in 2.127s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:26 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32 Jun 24 00:24:26 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:26 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f53333f-e327-4ef6-b2af-25b87f0ee36c" returned: 0 in 1.392s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-quobyte-1f53333f-e327-4ef6-b2af-25b87f0ee36c" released by "delete_volume" :: held 2.952s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Created reservations ['620bb1ff-bc05-4c33-b77a-7792f54619e8', '6edbb9c2-63ba-4127-b077-b73efded6dfc', 'f5d37cf1-67af-40ee-bb6d-8e871d781034', '48f7a72f-7c4d-45e7-a0dd-cda140a0930a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:26 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:26 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:27 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5379f801-c788-4467-bbbc-5780aa0eee32" returned: 0 in 1.134s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-quobyte-5379f801-c788-4467-bbbc-5780aa0eee32" released by "delete_volume" :: held 3.353s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Created reservations ['203e6e27-59b6-46ab-81e7-af9bb2e319eb', '4ca96bf8-68df-47e0-9a5b-40777c6f20b9', '60c9aa13-97c8-4522-8565-0722b14dd16c', '2f996db3-c497-4824-b785-6a63163a6bf7'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:27 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:27 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:27 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.185s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Deleted volume successfully. Jun 24 00:24:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-13db377a-7a47-4aa5-a146-f9fc6f106095 tempest-VolumesSnapshotNegativeTestJSON-408784639 None] Lock "cinder-1f53333f-e327-4ef6-b2af-25b87f0ee36c-delete_volume" released by "delete_volume" :: held 4.503s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-daeece84-bf74-4ee0-90c3-12aad0bf6f5c req-90ea058f-7647-42a5-88c3-ea09a1c6666c tempest-TestInstancesWithCinderVolumes-799263952 None] Terminate volume connection completed successfully. Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-daeece84-bf74-4ee0-90c3-12aad0bf6f5c req-90ea058f-7647-42a5-88c3-ea09a1c6666c tempest-TestInstancesWithCinderVolumes-799263952 None] Deleting attachment 3ce37dc3-f795-4c00-8117-e22a9530a77e. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Flow 'volume_create_manager' (9f71df5d-cd0a-4fd0-ba19-7062630774a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:28 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2494c4f4-495b-407e-9b8d-bb514218cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.817s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Deleted volume successfully. Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2494c4f4-495b-407e-9b8d-bb514218cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-4352860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4691c8-39db-431d-bb3b-3cc173d69132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16cc8e6f186046da84eb280d6bf29130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:28Z,use_quota=True,user_id='5e27b08fe6a5487a987cef6ab40b84dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8bfe40-b813-4632-a4ef-3ff398b78c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8bfe40-b813-4632-a4ef-3ff398b78c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2e6d9b-1a4d-42c0-9504-bda27e317998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2e6d9b-1a4d-42c0-9504-bda27e317998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4691c8-39db-431d-bb3b-3cc173d69132', 'volume_name': 'volume-1a4691c8-39db-431d-bb3b-3cc173d69132', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fe76e4-0f43-4aa2-bd9f-fbf17b70f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fe76e4-0f43-4aa2-bd9f-fbf17b70f510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505e2367-681f-47ad-aaf6-cbb766d3d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Volume 1a4691c8-39db-431d-bb3b-3cc173d69132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4691c8-39db-431d-bb3b-3cc173d69132', 'volume_size': 1} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-4352860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4691c8-39db-431d-bb3b-3cc173d69132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16cc8e6f186046da84eb280d6bf29130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:28Z,use_quota=True,user_id='5e27b08fe6a5487a987cef6ab40b84dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Creating volume 1a4691c8-39db-431d-bb3b-3cc173d69132 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:24:28 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-acaeb9b7-2a29-40c1-9afc-65479bc7a8c8 tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-5379f801-c788-4467-bbbc-5780aa0eee32-delete_volume" released by "delete_volume" :: held 4.611s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:28 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 1073741824 Jun 24 00:24:28 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "cinder-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "cinder-quobyte-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-quobyte-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f372cdac-92eb-49e6-b86b-a7fcc325e842]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:29 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 Jun 24 00:24:29 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:29 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 1073741824" returned: 0 in 1.080s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:29 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 Jun 24 00:24:29 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:29 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3" returned: 0 in 0.890s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:30 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3 Jun 24 00:24:30 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:30 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132" returned: 0 in 0.808s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505e2367-681f-47ad-aaf6-cbb766d3d74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4691c8-39db-431d-bb3b-3cc173d69132', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5c63c2-3670-40fe-8359-12efa78f74cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Volume volume-1a4691c8-39db-431d-bb3b-3cc173d69132 (1a4691c8-39db-431d-bb3b-3cc173d69132): created successfully Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5c63c2-3670-40fe-8359-12efa78f74cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Flow 'volume_create_manager' (9f71df5d-cd0a-4fd0-ba19-7062630774a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1f8f457f-a9b5-4d51-b3de-3ee4317af6f4 tempest-VolumesMetadataTest-1706181024 None] Created volume successfully. Jun 24 00:24:30 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3" returned: 0 in 0.826s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-quobyte-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3" released by "delete_volume" :: held 1.769s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Created reservations ['cf6d42c8-d13a-4279-9f32-a3868b16f3e1', '078b53a1-553d-4548-b48f-0bbbd9517c16', '472b7213-ee9e-44a3-95ec-3fac83eee57e', 'f6e69488-1a12-4a5c-b006-b11e5460ccb5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:30 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:30 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.770s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:31 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Deleted volume successfully. Jun 24 00:24:31 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7c3f550a-1440-4b49-ab91-1c98eebdbb17 tempest-AttachVolumeTestJSON-952325414 None] Lock "cinder-36bfa88a-b6b4-4401-8ea1-8bb4ef9465a3-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "cinder-933f2b67-ddd1-4661-975e-dc4b29c41d31-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-933f2b67-ddd1-4661-975e-dc4b29c41d31-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Acquiring lock "cinder-1a4691c8-39db-431d-bb3b-3cc173d69132-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "cinder-quobyte-933f2b67-ddd1-4661-975e-dc4b29c41d31" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-quobyte-933f2b67-ddd1-4661-975e-dc4b29c41d31" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Lock "cinder-1a4691c8-39db-431d-bb3b-3cc173d69132-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Acquiring lock "cinder-quobyte-1a4691c8-39db-431d-bb3b-3cc173d69132" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b1080-471a-4a74-8c7c-d2fdcfab4cd2]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Lock "cinder-quobyte-1a4691c8-39db-431d-bb3b-3cc173d69132" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddf406c-27b0-4845-b5ff-8458a2a849a6]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:32 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:24:32 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:33 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 Jun 24 00:24:33 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:33 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 0 in 0.882s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:33 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:24:33 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:33 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132" returned: 0 in 1.053s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:33 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132 Jun 24 00:24:33 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:34 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a4691c8-39db-431d-bb3b-3cc173d69132" returned: 0 in 0.728s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:34 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 1 in 0.983s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:24:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Lock "cinder-quobyte-1a4691c8-39db-431d-bb3b-3cc173d69132" released by "delete_volume" :: held 1.853s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:34 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31 Jun 24 00:24:34 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Created reservations ['f3c64635-ebdf-46a1-824d-3c86de0c3e55', 'b491d596-1fcd-47b7-a8c1-7b786b6e22ed', 'eb2009f4-f3ca-416d-b5d4-35f804c98997', '08f1ef5f-e06a-4ae6-9ccf-c75b1e478371'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:35 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:35 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:35 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-933f2b67-ddd1-4661-975e-dc4b29c41d31" returned: 0 in 1.186s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-quobyte-933f2b67-ddd1-4661-975e-dc4b29c41d31" released by "delete_volume" :: held 3.161s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:35 devstack cinder-volume[94472]: WARNING cinder.quota [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-759437530-633081292 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-759437530-633081292, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:24:35 devstack cinder-volume[94472]: WARNING cinder.quota [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-759437530-633081292 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-759437530-633081292, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Created reservations ['9f81fa57-2f18-4ad1-b841-35b5f92c42d7', '0f1105e9-4be2-4761-b0e1-358c4dc349d4', 'bc8d745c-b007-46a4-a211-20c14efedbc9', '53b6fd26-8bb0-48a3-b42a-e05efba51413'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:35 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.964s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:35 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Deleted volume successfully. Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dff2c0d-cde8-42f0-a318-5fb5a6b05438 tempest-VolumesMetadataTest-1706181024 None] Lock "cinder-1a4691c8-39db-431d-bb3b-3cc173d69132-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:36 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:36 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:36 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.892s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:36 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Deleted volume successfully. Jun 24 00:24:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e384440e-5516-4f26-b289-523b12a5bc9f tempest-TestInstancesWithCinderVolumes-799263952 None] Lock "cinder-933f2b67-ddd1-4661-975e-dc4b29c41d31-delete_volume" released by "delete_volume" :: held 4.382s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:24:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:39 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:39 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:40 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.859s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:24:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:24:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=126,cinder:INSERT=41,cinder:UPDATE=159,cinder:DELETE=13 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=146,cinder:SELECT=129,cinder:DELETE=11,cinder:INSERT=43 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Flow 'volume_create_manager' (20a42bc9-d81d-4e0a-a694-e44df3650490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd221e4a-2cde-464e-9630-78e4c2cf4b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd221e4a-2cde-464e-9630-78e4c2cf4b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-328592076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d59602-e054-4097-9852-cf564dd705aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9756819bc5409a975a80b2471b3045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:42Z,use_quota=True,user_id='e76fea229be84e8995061750acdf0319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e895bc8a-505b-4eba-83bd-f9a600c84320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e895bc8a-505b-4eba-83bd-f9a600c84320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19350e89-ff24-4b9c-8c45-9f9155c5b0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19350e89-ff24-4b9c-8c45-9f9155c5b0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d59602-e054-4097-9852-cf564dd705aa', 'volume_name': 'volume-33d59602-e054-4097-9852-cf564dd705aa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00ed69f-58e8-45b1-9bd3-c7086c0190cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00ed69f-58e8-45b1-9bd3-c7086c0190cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0eca5eb-dd84-4f5e-b342-f381f93baf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:42 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Volume 33d59602-e054-4097-9852-cf564dd705aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d59602-e054-4097-9852-cf564dd705aa', 'volume_size': 1} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-328592076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d59602-e054-4097-9852-cf564dd705aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9756819bc5409a975a80b2471b3045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:42Z,use_quota=True,user_id='e76fea229be84e8995061750acdf0319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Creating volume 33d59602-e054-4097-9852-cf564dd705aa {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:24:42 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:24:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:42 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa 1073741824 Jun 24 00:24:42 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:43 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa 1073741824" returned: 0 in 1.230s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:43 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa Jun 24 00:24:43 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:44 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa" returned: 0 in 0.801s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:24:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0eca5eb-dd84-4f5e-b342-f381f93baf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d59602-e054-4097-9852-cf564dd705aa', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e362fd75-b39d-468e-bac2-efcc474a9a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Volume volume-33d59602-e054-4097-9852-cf564dd705aa (33d59602-e054-4097-9852-cf564dd705aa): created successfully Jun 24 00:24:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e362fd75-b39d-468e-bac2-efcc474a9a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Flow 'volume_create_manager' (20a42bc9-d81d-4e0a-a694-e44df3650490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-22277b06-72cd-4f54-b5ec-74cb926335c7 tempest-VolumesTransfersTest-864552693 None] Created volume successfully. Jun 24 00:24:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e8b36734-7bb7-4b1d-92f1-10ce94facb60 tempest-VolumesTransfersTest-1145854871 None] Transfer volume completed successfully. Jun 24 00:24:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Acquiring lock "cinder-33d59602-e054-4097-9852-cf564dd705aa-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Lock "cinder-33d59602-e054-4097-9852-cf564dd705aa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Acquiring lock "cinder-quobyte-33d59602-e054-4097-9852-cf564dd705aa" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Lock "cinder-quobyte-33d59602-e054-4097-9852-cf564dd705aa" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad6a83-d7fd-4e3f-b394-5ead2c716d84]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:48 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa Jun 24 00:24:48 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:48 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa" returned: 0 in 0.906s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:48 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa Jun 24 00:24:48 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:49 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-33d59602-e054-4097-9852-cf564dd705aa" returned: 0 in 0.706s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Lock "cinder-quobyte-33d59602-e054-4097-9852-cf564dd705aa" released by "delete_volume" :: held 1.676s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Created reservations ['18791fa6-a641-4abf-bf37-4a60ef639e4f', '858caf4c-2f0d-4874-b020-8a379050796a', 'b70e1b91-4ea2-4d11-a559-dea91bd7b867', '58db4d9a-e817-44a9-9b53-c472474e9162'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:49 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:49 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:50 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.837s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:50 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Deleted volume successfully. Jun 24 00:24:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-08dd4f7f-ee3f-4f8b-82a0-4d19cd8a142d tempest-VolumesTransfersTest-512024500 None] Lock "cinder-33d59602-e054-4097-9852-cf564dd705aa-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:50 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:24:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Flow 'volume_create_manager' (7e7fefb6-b990-4058-aab4-c50ab7b69afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90ed614-f887-4bec-b13b-156ed785d383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90ed614-f887-4bec-b13b-156ed785d383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-24820853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af47b401-0438-4b2f-a606-691bb76a52bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9756819bc5409a975a80b2471b3045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:51Z,use_quota=True,user_id='e76fea229be84e8995061750acdf0319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ffa0dc-6fdd-4431-aff3-1bd7a682ffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ffa0dc-6fdd-4431-aff3-1bd7a682ffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b53a7fa-946b-4478-aedf-6b7002bf443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b53a7fa-946b-4478-aedf-6b7002bf443c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af47b401-0438-4b2f-a606-691bb76a52bd', 'volume_name': 'volume-af47b401-0438-4b2f-a606-691bb76a52bd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a475e6f4-8467-42f3-8fbf-f63c749aef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a475e6f4-8467-42f3-8fbf-f63c749aef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249c4867-f420-4b10-afc5-7ac4c7c213c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Volume af47b401-0438-4b2f-a606-691bb76a52bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af47b401-0438-4b2f-a606-691bb76a52bd', 'volume_size': 1} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-24820853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af47b401-0438-4b2f-a606-691bb76a52bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9756819bc5409a975a80b2471b3045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:24:51Z,use_quota=True,user_id='e76fea229be84e8995061750acdf0319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Creating volume af47b401-0438-4b2f-a606-691bb76a52bd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:24:51 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:24:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:51 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd 1073741824 Jun 24 00:24:51 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:52 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd 1073741824" returned: 0 in 1.233s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:52 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd Jun 24 00:24:52 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:53 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd" returned: 0 in 0.765s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:24:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249c4867-f420-4b10-afc5-7ac4c7c213c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af47b401-0438-4b2f-a606-691bb76a52bd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffc272d-7fa8-44e7-a53c-554c782a62af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:24:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Volume volume-af47b401-0438-4b2f-a606-691bb76a52bd (af47b401-0438-4b2f-a606-691bb76a52bd): created successfully Jun 24 00:24:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffc272d-7fa8-44e7-a53c-554c782a62af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:24:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Flow 'volume_create_manager' (7e7fefb6-b990-4058-aab4-c50ab7b69afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:24:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-870f9503-a0a1-4354-9516-8938ad74b9b2 tempest-VolumesTransfersTest-864552693 None] Created volume successfully. Jun 24 00:24:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Acquiring lock "cinder-af47b401-0438-4b2f-a606-691bb76a52bd-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Lock "cinder-af47b401-0438-4b2f-a606-691bb76a52bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Acquiring lock "cinder-quobyte-af47b401-0438-4b2f-a606-691bb76a52bd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:24:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Lock "cinder-quobyte-af47b401-0438-4b2f-a606-691bb76a52bd" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:24:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1235a4c-f8f1-4ac1-b446-624b1b3753a2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:24:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:54 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd Jun 24 00:24:54 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:55 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd" returned: 0 in 0.959s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:55 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd Jun 24 00:24:55 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:56 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-af47b401-0438-4b2f-a606-691bb76a52bd" returned: 0 in 0.736s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Lock "cinder-quobyte-af47b401-0438-4b2f-a606-691bb76a52bd" released by "delete_volume" :: held 1.760s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Created reservations ['1b980ff0-eda1-4a11-b0e4-42315640e0cb', '5c38351c-5185-4149-9cda-cd8b040de0dc', 'f465aa6a-095e-481f-85e6-df220d7eeba0', '5c7574b1-3d1d-4350-a675-73ca7247071a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:24:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:24:56 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:24:56 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:24:57 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jun 24 00:24:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.896s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:24:57 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:24:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Deleted volume successfully. Jun 24 00:24:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-843e1b60-ace3-4c38-b68f-4f66597d03ba tempest-VolumesTransfersTest-512024500 None] Lock "cinder-af47b401-0438-4b2f-a606-691bb76a52bd-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:25:06 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=17,cinder:DELETE=1,cinder:SELECT=12,cinder:INSERT=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:25:07 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=16,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:25:08 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:25:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Flow 'volume_create_manager' (c25df089-1954-4a44-9c6b-b06b631d255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fa5b07-bbdf-4996-96f5-f89ce0d9930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fa5b07-bbdf-4996-96f5-f89ce0d9930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1137651698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0d24d2-cff5-428d-8ddf-823c2882d60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592531152a4b4334b94d248ec5dc64a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:08Z,use_quota=True,user_id='20239c7c24244cb3addaa91ab2ee6dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4e2bb8-d979-48cd-8d2e-1ee50e489c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4e2bb8-d979-48cd-8d2e-1ee50e489c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535d5cc3-8a20-46a6-8aed-c7e480c76f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:08 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (9be97fe5-15dc-439b-a1d7-6ff7b0f272df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6dbe0f3-c105-4b03-9eea-65386cb66e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6dbe0f3-c105-4b03-9eea-65386cb66e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1093611817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b148d44e-4a90-406d-834e-ab34ea5bce39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:09Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87338c-813b-42da-9212-a43e079812a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87338c-813b-42da-9212-a43e079812a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfd162c-68cc-4fce-9d81-06ef180a6704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfd162c-68cc-4fce-9d81-06ef180a6704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b148d44e-4a90-406d-834e-ab34ea5bce39', 'volume_name': 'volume-b148d44e-4a90-406d-834e-ab34ea5bce39', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f4b3c4-0f37-4e47-9cb2-e5dc7889cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f4b3c4-0f37-4e47-9cb2-e5dc7889cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7a0ed4-6c02-4cdf-b4c1-1b6e4905dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Volume b148d44e-4a90-406d-834e-ab34ea5bce39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b148d44e-4a90-406d-834e-ab34ea5bce39', 'volume_size': 1} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1093611817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b148d44e-4a90-406d-834e-ab34ea5bce39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:09Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Creating volume b148d44e-4a90-406d-834e-ab34ea5bce39 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:25:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535d5cc3-8a20-46a6-8aed-c7e480c76f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b0d24d2-cff5-428d-8ddf-823c2882d60b', 'volume_name': 'volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d550883-b7df-48c2-acd7-fbdb9294eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:09 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 1073741824 Jun 24 00:25:09 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d550883-b7df-48c2-acd7-fbdb9294eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea0341f-53a7-490b-8237-d7e8fa1440b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Volume 3b0d24d2-cff5-428d-8ddf-823c2882d60b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Trying to clone 3b0d24d2-cff5-428d-8ddf-823c2882d60b from image f57f6d67-fa39-4fca-b804-ab80f4171967 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:25:09 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Image download 20.69 MB at 20.69 MB/s Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c029865-7567-4059-aa6e-57e3926a733e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:10 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD Jun 24 00:25:10 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:10 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 1073741824" returned: 0 in 1.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:10 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 Jun 24 00:25:10 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:10 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD" returned: 0 in 0.926s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:10 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Temporary image f57f6d67-fa39-4fca-b804-ab80f4171967 is fetched for user 20239c7c24244cb3addaa91ab2ee6dad. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:25:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a9e18b-7077-4eef-a52f-60b571e81219]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:11 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD Jun 24 00:25:11 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:11 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39" returned: 0 in 0.859s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7a0ed4-6c02-4cdf-b4c1-1b6e4905dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b148d44e-4a90-406d-834e-ab34ea5bce39', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922398e8-c465-4409-aad4-d7bce378cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Volume volume-b148d44e-4a90-406d-834e-ab34ea5bce39 (b148d44e-4a90-406d-834e-ab34ea5bce39): created successfully Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922398e8-c465-4409-aad4-d7bce378cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (9be97fe5-15dc-439b-a1d7-6ff7b0f272df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-edeaa1ec-edfe-4add-bd41-e1403241b308 tempest-VolumesGetTest-1903838423 None] Created volume successfully. Jun 24 00:25:11 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD" returned: 0 in 0.947s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1137651698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0d24d2-cff5-428d-8ddf-823c2882d60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592531152a4b4334b94d248ec5dc64a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:08Z,use_quota=True,user_id='20239c7c24244cb3addaa91ab2ee6dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Creating volume 3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:25:11 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:25:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:11 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b 1073741824 Jun 24 00:25:11 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:12 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b 1073741824" returned: 0 in 0.962s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:12 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:25:12 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (b9e12cab-1b40-4649-a870-125da64a7e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bd093c-1251-45c1-8263-c87906b506cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bd093c-1251-45c1-8263-c87906b506cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1598048148',display_name='tempest-VolumesGetTest-Volume-1693071567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82765fd3-d01d-4360-9547-941b35e1bf4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:13Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01cb421-14a1-4307-b983-066ce570c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01cb421-14a1-4307-b983-066ce570c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5aaa86-0d0a-40f0-8f8f-9262ce167023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5aaa86-0d0a-40f0-8f8f-9262ce167023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82765fd3-d01d-4360-9547-941b35e1bf4e', 'volume_name': 'volume-82765fd3-d01d-4360-9547-941b35e1bf4e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba650287-b641-4b6e-8f7c-eb85e90595f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba650287-b641-4b6e-8f7c-eb85e90595f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a225750-4073-41c1-9c56-de745616157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Volume 82765fd3-d01d-4360-9547-941b35e1bf4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82765fd3-d01d-4360-9547-941b35e1bf4e', 'volume_size': 1} Jun 24 00:25:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:14 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 0 in 1.122s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1598048148',display_name='tempest-VolumesGetTest-Volume-1693071567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82765fd3-d01d-4360-9547-941b35e1bf4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:13Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Creating volume 82765fd3-d01d-4360-9547-941b35e1bf4e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:25:14 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:14 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e 1073741824 Jun 24 00:25:14 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Attempting download of f57f6d67-fa39-4fca-b804-ab80f4171967 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}])) to volume 3b0d24d2-cff5-428d-8ddf-823c2882d60b. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd603bb-3c64-4d2c-a073-b00b1d188b14]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_gq3x0pys {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:14 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_gq3x0pys Jun 24 00:25:14 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:15 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e 1073741824" returned: 0 in 1.117s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:15 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_gq3x0pys" returned: 0 in 0.995s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_gq3x0pys {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:15 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e Jun 24 00:25:15 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:15 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_gq3x0pys Jun 24 00:25:15 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:16 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e" returned: 0 in 0.988s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a225750-4073-41c1-9c56-de745616157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82765fd3-d01d-4360-9547-941b35e1bf4e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6896726a-25ac-483b-84b3-6a4443613298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Volume volume-82765fd3-d01d-4360-9547-941b35e1bf4e (82765fd3-d01d-4360-9547-941b35e1bf4e): created successfully Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6896726a-25ac-483b-84b3-6a4443613298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:16 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (b9e12cab-1b40-4649-a870-125da64a7e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_gq3x0pys" returned: 1 in 1.040s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_gq3x0pys' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5792ddec-0006-4526-a5e0-84f9f8d3ec3b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-80d25082-0be4-4c42-854a-f6ee94921da9 tempest-VolumesGetTest-1903838423 None] Created volume successfully. Jun 24 00:25:16 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD Jun 24 00:25:16 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:17 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD" returned: 0 in 0.942s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] f57f6d67-fa39-4fca-b804-ab80f4171967 was qcow2, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:17 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:25:17 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-82765fd3-d01d-4360-9547-941b35e1bf4e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Lock "cinder-82765fd3-d01d-4360-9547-941b35e1bf4e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-82765fd3-d01d-4360-9547-941b35e1bf4e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-82765fd3-d01d-4360-9547-941b35e1bf4e" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d617c-dd45-4cf2-821b-fc9ff037b918]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:17 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e Jun 24 00:25:17 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:19 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e" returned: 0 in 1.330s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:19 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e Jun 24 00:25:19 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:20 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-82765fd3-d01d-4360-9547-941b35e1bf4e" returned: 0 in 0.921s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-82765fd3-d01d-4360-9547-941b35e1bf4e" released by "delete_volume" :: held 2.327s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Created reservations ['5604a007-c5eb-4a7b-9d4b-7ce4075ee283', 'ad4a1cf2-abbc-44ab-9505-8799b77666c7', '9243a705-3d26-40ca-a46b-ecb697d1fc9f', '74299f28-a255-4b48-ae63-b081f12189ac'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:20 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:25:20 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:20 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 0 in 3.267s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_8t04qw6wdevstack@QuobyteHD, size 112.00 MB, duration 3.27 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:25:20 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Converted 112.00 MB image at 34.27 MB/s Jun 24 00:25:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:20 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b 1G Jun 24 00:25:20 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:21 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:25:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Deleted volume successfully. Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db29e158-8625-40e6-a1db-62a38b77681c tempest-VolumesGetTest-1903838423 None] Lock "cinder-82765fd3-d01d-4360-9547-941b35e1bf4e-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-b148d44e-4a90-406d-834e-ab34ea5bce39-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Lock "cinder-b148d44e-4a90-406d-834e-ab34ea5bce39-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-b148d44e-4a90-406d-834e-ab34ea5bce39" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-b148d44e-4a90-406d-834e-ab34ea5bce39" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c810d52e-3fd7-4727-ac73-d303d03fa17f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:21 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b 1G" returned: 0 in 1.042s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f1978-5a36-480e-906c-32528cf79717]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:21 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 Jun 24 00:25:21 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:21 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:25:21 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:22 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39" returned: 0 in 1.006s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:22 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39 Jun 24 00:25:22 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:22 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 0 in 1.052s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:22 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:25:22 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:23 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b148d44e-4a90-406d-834e-ab34ea5bce39" returned: 0 in 0.870s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-b148d44e-4a90-406d-834e-ab34ea5bce39" released by "delete_volume" :: held 1.930s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Created reservations ['aad4d97a-ba53-4f7a-a093-d6a24567eb39', '710b38ba-a20b-4c82-a724-ee121eb63d5e', 'a4fc6141-e4c8-49b4-8bd7-a884d5caffcf', '32f2a07c-1067-410d-9b9f-2415fccbea63'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:25:23 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 1 in 0.881s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Downloaded image f57f6d67-fa39-4fca-b804-ab80f4171967 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}])) to volume 3b0d24d2-cff5-428d-8ddf-823c2882d60b successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Temporary image f57f6d67-fa39-4fca-b804-ab80f4171967 for user 20239c7c24244cb3addaa91ab2ee6dad is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Marking volume 3b0d24d2-cff5-428d-8ddf-823c2882d60b as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Copying metadata from image f57f6d67-fa39-4fca-b804-ab80f4171967 to 3b0d24d2-cff5-428d-8ddf-823c2882d60b. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Creating volume glance metadata for volume 3b0d24d2-cff5-428d-8ddf-823c2882d60b backed by image f57f6d67-fa39-4fca-b804-ab80f4171967 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:23 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:25:23 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea0341f-53a7-490b-8237-d7e8fa1440b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e717d07-b4c5-450c-a081-45510d19cd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Volume volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b (3b0d24d2-cff5-428d-8ddf-823c2882d60b): created successfully Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e717d07-b4c5-450c-a081-45510d19cd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Flow 'volume_create_manager' (c25df089-1954-4a44-9c6b-b06b631d255d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-abf129ea-7118-4dc7-be89-4adc9a686075 tempest-TestShelveInstance-1466731303 None] Created volume successfully. Jun 24 00:25:24 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.877s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:25:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Deleted volume successfully. Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef7dff4e-c57a-4827-8a69-f148d40bf3be tempest-VolumesGetTest-1903838423 None] Lock "cinder-b148d44e-4a90-406d-834e-ab34ea5bce39-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (3fe97b1d-63c2-439b-9a94-c1eab77b6d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073b70c6-c90c-4f5f-81e1-6724a9a4da52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073b70c6-c90c-4f5f-81e1-6724a9a4da52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1689035971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e18492-1318-4986-b0ef-d9027cc2ce06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:25Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9fb265-f1a4-4912-be06-b4eca1512718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9fb265-f1a4-4912-be06-b4eca1512718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5131c352-538b-4651-875d-2190bc643752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5131c352-538b-4651-875d-2190bc643752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e18492-1318-4986-b0ef-d9027cc2ce06', 'volume_name': 'volume-e4e18492-1318-4986-b0ef-d9027cc2ce06', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d376d7-0026-455b-a16a-47f499a4e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d376d7-0026-455b-a16a-47f499a4e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653dec48-93ca-4134-a391-a52d1b32c5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Volume e4e18492-1318-4986-b0ef-d9027cc2ce06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e18492-1318-4986-b0ef-d9027cc2ce06', 'volume_size': 1} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1689035971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e18492-1318-4986-b0ef-d9027cc2ce06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:25Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Creating volume e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:25:24 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:25:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:24 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 1073741824 Jun 24 00:25:24 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:26 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 1073741824" returned: 0 in 1.276s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:26 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 Jun 24 00:25:26 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:27 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06" returned: 0 in 1.322s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] <== create_volume: return (2655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:25:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.658s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653dec48-93ca-4134-a391-a52d1b32c5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e18492-1318-4986-b0ef-d9027cc2ce06', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d622d878-8415-4cb8-8406-fc1144b06e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Volume volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 (e4e18492-1318-4986-b0ef-d9027cc2ce06): created successfully Jun 24 00:25:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d622d878-8415-4cb8-8406-fc1144b06e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (3fe97b1d-63c2-439b-9a94-c1eab77b6d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6144eb42-1361-4e0c-b725-74fbe3927f47 tempest-VolumesGetTest-1903838423 None] Created volume successfully. Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (97133960-a6eb-42de-8070-275db71fc956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906b28df-a936-4736-baed-62ca3981ef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906b28df-a936-4736-baed-62ca3981ef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1828102530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3d9790-f4f2-4f54-9b4f-4abe0ab76740,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e4e18492-1318-4986-b0ef-d9027cc2ce06,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:29Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b093aaa2-1422-4e0d-8282-b5c7e5015f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b093aaa2-1422-4e0d-8282-b5c7e5015f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1dd39b5-d6d0-4acf-b3ed-13e8b2090a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1dd39b5-d6d0-4acf-b3ed-13e8b2090a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7f3d9790-f4f2-4f54-9b4f-4abe0ab76740', 'volume_name': 'volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740', 'volume_size': 1, 'source_volid': 'e4e18492-1318-4986-b0ef-d9027cc2ce06', 'source_volstatus': 'available'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9929a4bc-9f7d-4ba8-96f7-6e09ae257747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9929a4bc-9f7d-4ba8-96f7-6e09ae257747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484f2b5e-4e8e-4f06-83d1-d1da3079adf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Volume 7f3d9790-f4f2-4f54-9b4f-4abe0ab76740: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740', 'volume_size': 1, 'source_volid': 'e4e18492-1318-4986-b0ef-d9027cc2ce06', 'source_volstatus': 'available'} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:29 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Cloning volume e4e18492-1318-4986-b0ef-d9027cc2ce06 to volume 7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Creating offline snapshot bfa93dfe-490e-40b2-8373-521b0ee1c646 of volume e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7476fbab-41a3-401f-9311-6f3882eaf993]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:29 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 Jun 24 00:25:29 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:30 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06" returned: 0 in 1.472s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:30 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 1G Jun 24 00:25:30 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:32 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 1G" returned: 0 in 1.468s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:32 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 Jun 24 00:25:32 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:33 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646" returned: 0 in 1.262s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:33 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 is being set with open permissions: ugo+rw Jun 24 00:25:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:33 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 Jun 24 00:25:33 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:34 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646" returned: 0 in 0.842s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:34 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.info Jun 24 00:25:34 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:35 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.info" returned: 0 in 1.271s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:35 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.info is being set with open permissions: ugo+rw Jun 24 00:25:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:35 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.info Jun 24 00:25:35 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:36 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.info" returned: 0 in 0.989s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] snapshot: bfa93dfe-490e-40b2-8373-521b0ee1c646, volume: 7f3d9790-f4f2-4f54-9b4f-4abe0ab76740, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[699b558d-65d4-4ea0-8f86-b1a3222cedb3]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:37 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 Jun 24 00:25:37 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:38 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646" returned: 0 in 1.154s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4e18492-1318-4986-b0ef-d9027cc2ce06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:25:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:25:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:25:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e2bfa2-aeaa-4f5d-8da0-8dd65b5dce98]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:38 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 Jun 24 00:25:38 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:39 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06" returned: 0 in 1.180s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:39 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 Jun 24 00:25:39 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:39 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:25:39 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:40 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.059s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:25:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:25:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:25:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:25:44 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=32,cinder:SELECT=30,cinder:INSERT=13,cinder:DELETE=4 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:25:44 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=30,cinder:UPDATE=29,cinder:INSERT=14,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:25:45 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" returned: 0 in 5.769s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:45 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4ca09-6375-4eb4-bc6f-cd06e52db0b1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:45 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 Jun 24 00:25:45 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:45 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06" returned: 0 in 0.918s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:45 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:25:45 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Converted 1024.00 MB image at 177.46 MB/s Jun 24 00:25:45 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 is being set with open permissions: ugo+rw Jun 24 00:25:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:45 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 Jun 24 00:25:45 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:46 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" returned: 0 in 0.808s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" released by "_copy_volume_from_snapshot" :: held 9.982s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:25:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-bfa93dfe-490e-40b2-8373-521b0ee1c646" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-bfa93dfe-490e-40b2-8373-521b0ee1c646" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Deleting offline snapshot bfa93dfe-490e-40b2-8373-521b0ee1c646 of volume e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:25:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] snapshot_file for this snap is: volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:25:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f183095e-3a5a-462c-8cf7-9d4615393983]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:46 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 Jun 24 00:25:46 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:47 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646" returned: 0 in 0.987s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4e18492-1318-4986-b0ef-d9027cc2ce06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:25:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee108f-664e-4bdd-9f50-406d35a5d924]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:48 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 Jun 24 00:25:48 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:48 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06" returned: 0 in 0.970s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:48 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 Jun 24 00:25:48 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:49 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646" returned: 0 in 0.955s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:49 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646 Jun 24 00:25:49 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:50 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06.bfa93dfe-490e-40b2-8373-521b0ee1c646" returned: 0 in 0.677s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-bfa93dfe-490e-40b2-8373-521b0ee1c646" released by "_delete_snapshot" :: held 3.719s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.367s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.481s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484f2b5e-4e8e-4f06-83d1-d1da3079adf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740', 'volume_size': 1, 'source_volid': 'e4e18492-1318-4986-b0ef-d9027cc2ce06', 'source_volstatus': 'available'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f71625-bfcf-4248-8eae-cdf8099d06ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9b13af-c9fa-48ff-8bda-f838434493f2]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:50 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Volume volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 (7f3d9790-f4f2-4f54-9b4f-4abe0ab76740): created successfully Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f71625-bfcf-4248-8eae-cdf8099d06ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (97133960-a6eb-42de-8070-275db71fc956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2ff69526-9066-4344-b38b-32ef933b84cd tempest-VolumesGetTest-1903838423 None] Created volume successfully. Jun 24 00:25:50 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:25:50 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:51 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 0 in 0.827s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:51 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:25:51 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:51 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:25:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (23891c4f-9b46-4d32-a297-fd7e23cd8804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22c9307-1b50-42c1-b4ac-d6196737319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22c9307-1b50-42c1-b4ac-d6196737319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2077715478',display_name='tempest-VolumesGetTest-Volume-1326685759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2b6c06-b7f6-4104-bb2a-87b85846bb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:52Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90dd539-b04d-42ab-afab-43965f97fec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90dd539-b04d-42ab-afab-43965f97fec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cabf5f-7c94-4930-a094-45b56a751bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cabf5f-7c94-4930-a094-45b56a751bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2b6c06-b7f6-4104-bb2a-87b85846bb50', 'volume_name': 'volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8194a15e-445c-4252-b86f-1462902a865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8194a15e-445c-4252-b86f-1462902a865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c6feef-403c-4eee-8e87-125f5c43f674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Volume fa2b6c06-b7f6-4104-bb2a-87b85846bb50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50', 'volume_size': 1} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:52 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 1 in 0.831s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.711s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2077715478',display_name='tempest-VolumesGetTest-Volume-1326685759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2b6c06-b7f6-4104-bb2a-87b85846bb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:52Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Creating volume fa2b6c06-b7f6-4104-bb2a-87b85846bb50 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:25:52 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:52 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 1073741824 Jun 24 00:25:52 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3803e7d9-a1a9-425e-9407-4de6c54904d2', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:25:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-c17dadef-7c55-4c66-949e-16e035fe71d0 req-71dbe49e-6a53-4d3f-b652-1f0af5c61191 tempest-TestShelveInstance-1466731303 None] attachment_update completed successfully. Jun 24 00:25:53 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 1073741824" returned: 0 in 1.015s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:53 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 Jun 24 00:25:53 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:54 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50" returned: 0 in 1.128s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] <== create_volume: return (2202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:25:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c6feef-403c-4eee-8e87-125f5c43f674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56ccbd8-9dfc-49a4-b713-adf49fa6c86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:54 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Volume volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 (fa2b6c06-b7f6-4104-bb2a-87b85846bb50): created successfully Jun 24 00:25:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56ccbd8-9dfc-49a4-b713-adf49fa6c86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (23891c4f-9b46-4d32-a297-fd7e23cd8804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:54 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9a62d598-f167-4eb2-88cc-3f7a4a7205c3 tempest-VolumesGetTest-1903838423 None] Created volume successfully. Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-fa2b6c06-b7f6-4104-bb2a-87b85846bb50-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Lock "cinder-fa2b6c06-b7f6-4104-bb2a-87b85846bb50-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-fa2b6c06-b7f6-4104-bb2a-87b85846bb50" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-fa2b6c06-b7f6-4104-bb2a-87b85846bb50" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[74629044-ab74-4a0c-8273-0ef3d30ca1d5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:55 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 Jun 24 00:25:55 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Flow 'volume_create_manager' (e0e446b3-4700-4659-8544-f1c4a840a4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734f98fb-7362-4431-ae8c-b5069165c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734f98fb-7362-4431-ae8c-b5069165c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-326580078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c9ef33-3d2a-480e-81bb-88a57cb43419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9a2907c9a44ae087dfe42472ebabf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:56Z,use_quota=True,user_id='248d0018694b4c8abd389ae5ca3ae6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c52d26-3691-489d-827e-d4334bb84e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c52d26-3691-489d-827e-d4334bb84e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b433e2-e8c9-47bc-ace1-ad115f78228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b433e2-e8c9-47bc-ace1-ad115f78228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c9ef33-3d2a-480e-81bb-88a57cb43419', 'volume_name': 'volume-64c9ef33-3d2a-480e-81bb-88a57cb43419', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4469118-b8f5-4536-b5b9-5d9794cbcf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4469118-b8f5-4536-b5b9-5d9794cbcf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc886503-c211-4cbd-b485-fe9561096cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Volume 64c9ef33-3d2a-480e-81bb-88a57cb43419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c9ef33-3d2a-480e-81bb-88a57cb43419', 'volume_size': 1} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-326580078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c9ef33-3d2a-480e-81bb-88a57cb43419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9a2907c9a44ae087dfe42472ebabf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:25:56Z,use_quota=True,user_id='248d0018694b4c8abd389ae5ca3ae6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Creating volume 64c9ef33-3d2a-480e-81bb-88a57cb43419 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:25:55 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:25:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:55 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 1073741824 Jun 24 00:25:55 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:56 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50" returned: 0 in 1.142s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:56 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50 Jun 24 00:25:56 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:57 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 1073741824" returned: 0 in 1.361s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:57 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 Jun 24 00:25:57 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:57 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-fa2b6c06-b7f6-4104-bb2a-87b85846bb50" returned: 0 in 0.724s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-fa2b6c06-b7f6-4104-bb2a-87b85846bb50" released by "delete_volume" :: held 1.941s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Created reservations ['d22395a0-0a6a-4697-9a71-315f19f46681', '2dce7d35-1b48-455b-a6f0-1c0900f17190', '46884eea-42b7-496e-a636-3ce80f2db584', 'b4b81828-bdac-447f-b220-d09165262f82'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:57 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:25:57 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Lock "cinder-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" acquired by "delete_volume" :: waited 0.048s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ba897a-92c7-40fc-9c22-1a6853f519fc]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:25:58 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419" returned: 0 in 1.223s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] <== create_volume: return (2626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.629s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc886503-c211-4cbd-b485-fe9561096cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c9ef33-3d2a-480e-81bb-88a57cb43419', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7179759-3110-4138-a08f-485aa542ebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:25:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Volume volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 (64c9ef33-3d2a-480e-81bb-88a57cb43419): created successfully Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7179759-3110-4138-a08f-485aa542ebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Flow 'volume_create_manager' (e0e446b3-4700-4659-8544-f1c4a840a4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:25:58 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 Jun 24 00:25:58 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:25:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7ffa72c6-70e9-4fdf-8ff2-9d3dcee53eb7 tempest-AttachVolumeNegativeTest-495043411 None] Created volume successfully. Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.125s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:25:58 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jun 24 00:25:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Deleted volume successfully. Jun 24 00:25:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-46d25835-1df8-4f9d-b2fe-e60042259bed tempest-VolumesGetTest-1903838423 None] Lock "cinder-fa2b6c06-b7f6-4104-bb2a-87b85846bb50-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:00 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" returned: 0 in 1.878s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:00 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740 Jun 24 00:26:00 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Flow 'volume_create_manager' (3e09b29f-cc9e-4114-b09b-e8d264ae1df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f584fba-38da-4480-a614-44d03fbc06d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f584fba-38da-4480-a614-44d03fbc06d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1140493555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e8d164-6e67-41b0-8e0b-f54b67f5af34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffd7d4c2dd04d21a389a81321d27d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:26:01Z,use_quota=True,user_id='290cafdbd5944164bfa7e66bc9afc79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcee0eb-5807-4244-8209-9b4d314708fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcee0eb-5807-4244-8209-9b4d314708fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86944670-3989-4203-a617-874d24eadeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86944670-3989-4203-a617-874d24eadeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e8d164-6e67-41b0-8e0b-f54b67f5af34', 'volume_name': 'volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb88ea2a-3a44-4d45-a0e0-0997304c71d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb88ea2a-3a44-4d45-a0e0-0997304c71d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee036b4-834b-42de-a307-69f5f0c19c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:01 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Volume 38e8d164-6e67-41b0-8e0b-f54b67f5af34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34', 'volume_size': 1} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1140493555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e8d164-6e67-41b0-8e0b-f54b67f5af34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffd7d4c2dd04d21a389a81321d27d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:26:01Z,use_quota=True,user_id='290cafdbd5944164bfa7e66bc9afc79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Creating volume 38e8d164-6e67-41b0-8e0b-f54b67f5af34 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:26:01 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:01 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 1073741824 Jun 24 00:26:01 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:01 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" returned: 0 in 1.231s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740" released by "delete_volume" :: held 3.196s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Created reservations ['293a6051-14eb-4918-a29c-b52ebbb77b87', '4a58d3e7-9464-4c20-a664-1c9872633fe9', '5e4ce873-5060-450c-a0dc-1afd133b9b31', 'c12d4cf0-5e4f-4d17-9f44-9c54caef9f81'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:01 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:26:01 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6eca1367-05c3-4573-9b86-5c95cd17db81 req-fad428ee-65cb-4bea-84dd-6c68223e96f8 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-e4e18492-1318-4986-b0ef-d9027cc2ce06-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Lock "cinder-e4e18492-1318-4986-b0ef-d9027cc2ce06-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-e4e18492-1318-4986-b0ef-d9027cc2ce06" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-e4e18492-1318-4986-b0ef-d9027cc2ce06" acquired by "delete_volume" :: waited 0.052s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f7e38-4b7a-453c-8f35-faafb63599aa]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:03 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 1073741824" returned: 0 in 2.124s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:03 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.815s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:26:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Deleted volume successfully. Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:03 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 Jun 24 00:26:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84b8d6a1-71f5-40e3-9df2-995d6b4aadca tempest-VolumesGetTest-1903838423 None] Lock "cinder-7f3d9790-f4f2-4f54-9b4f-4abe0ab76740-delete_volume" released by "delete_volume" :: held 5.558s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:03 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:03 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 Jun 24 00:26:03 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:04 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06" returned: 0 in 1.546s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:04 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06 Jun 24 00:26:04 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:04 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34" returned: 0 in 1.503s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] <== create_volume: return (3724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:26:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.729s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6eca1367-05c3-4573-9b86-5c95cd17db81 req-fad428ee-65cb-4bea-84dd-6c68223e96f8 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.061s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee036b4-834b-42de-a307-69f5f0c19c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701b1705-679a-4734-bed2-32e6838b3959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Volume volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 (38e8d164-6e67-41b0-8e0b-f54b67f5af34): created successfully Jun 24 00:26:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701b1705-679a-4734-bed2-32e6838b3959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Flow 'volume_create_manager' (3e09b29f-cc9e-4114-b09b-e8d264ae1df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:26:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d781492b-9cef-44ef-ad4f-8e973a3af8c5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-6eca1367-05c3-4573-9b86-5c95cd17db81 req-fad428ee-65cb-4bea-84dd-6c68223e96f8 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-72c456ef-2486-4771-ad7e-a16ee98b5b39 tempest-TestMinimumBasicScenario-435940803 None] Created volume successfully. Jun 24 00:26:05 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 Jun 24 00:26:05 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:06 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e4e18492-1318-4986-b0ef-d9027cc2ce06" returned: 0 in 1.804s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-e4e18492-1318-4986-b0ef-d9027cc2ce06" released by "delete_volume" :: held 3.462s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Created reservations ['062ac60c-666a-46d9-89dc-466c502e50df', '3163f570-09ea-4d80-b9aa-ea2c94327ee0', 'a705a323-c73d-4e5e-ab92-edb05dcdb8e2', '9658b680-5b9d-4b38-bdb7-4a42571a3154'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:06 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:26:06 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:07 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-6eca1367-05c3-4573-9b86-5c95cd17db81 req-fad428ee-65cb-4bea-84dd-6c68223e96f8 tempest-AttachVolumeNegativeTest-495043411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419" returned: 0 in 2.111s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6eca1367-05c3-4573-9b86-5c95cd17db81 req-fad428ee-65cb-4bea-84dd-6c68223e96f8 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.226s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-6eca1367-05c3-4573-9b86-5c95cd17db81 req-fad428ee-65cb-4bea-84dd-6c68223e96f8 tempest-AttachVolumeNegativeTest-495043411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-64c9ef33-3d2a-480e-81bb-88a57cb43419', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a31c3294-dd29-41e3-ba11-64da59fa0e63', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:26:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-6eca1367-05c3-4573-9b86-5c95cd17db81 req-fad428ee-65cb-4bea-84dd-6c68223e96f8 tempest-AttachVolumeNegativeTest-495043411 None] attachment_update completed successfully. Jun 24 00:26:08 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.390s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:08 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:26:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Deleted volume successfully. Jun 24 00:26:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2aba21c7-56bc-4283-9cd9-26d6c20325ed tempest-VolumesGetTest-1903838423 None] Lock "cinder-e4e18492-1318-4986-b0ef-d9027cc2ce06-delete_volume" released by "delete_volume" :: held 5.370s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (b47800a8-2642-4cf6-9e8c-0ea5c072a04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced715ed-be6b-4509-8a8b-7dc3892e13e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-de8932c3-f36a-4fde-8ed8-ae1450cc7a0b req-b5257b8b-2063-4e20-8cd2-ec09e548e4f8 tempest-TestMinimumBasicScenario-435940803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-de8932c3-f36a-4fde-8ed8-ae1450cc7a0b req-b5257b8b-2063-4e20-8cd2-ec09e548e4f8 tempest-TestMinimumBasicScenario-435940803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced715ed-be6b-4509-8a8b-7dc3892e13e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1377145416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c433a10f-0cef-41b4-a848-34a9d2822aa4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:26:10Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f55159-2564-46b3-90e0-e2ecfedf4552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f55159-2564-46b3-90e0-e2ecfedf4552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513665f8-e19f-4684-8b3a-f5e86c93f32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:09 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c682b93-6166-452f-8f99-e7812db772ce]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-de8932c3-f36a-4fde-8ed8-ae1450cc7a0b req-b5257b8b-2063-4e20-8cd2-ec09e548e4f8 tempest-TestMinimumBasicScenario-435940803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:10 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 Jun 24 00:26:10 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513665f8-e19f-4684-8b3a-f5e86c93f32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c433a10f-0cef-41b4-a848-34a9d2822aa4', 'volume_name': 'volume-c433a10f-0cef-41b4-a848-34a9d2822aa4', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6760c43d-d546-4fc1-972a-e11efb3e0a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6760c43d-d546-4fc1-972a-e11efb3e0a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf264d4-07b1-4651-bb2a-d3aa4aee0d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Volume c433a10f-0cef-41b4-a848-34a9d2822aa4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c433a10f-0cef-41b4-a848-34a9d2822aa4', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Trying to clone c433a10f-0cef-41b4-a848-34a9d2822aa4 from image f57f6d67-fa39-4fca-b804-ab80f4171967 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:26:10 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Image download 20.69 MB at 20.69 MB/s Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[56196b87-058c-40a1-b5d1-58150bad3d8e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:10 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD Jun 24 00:26:10 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:11 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-de8932c3-f36a-4fde-8ed8-ae1450cc7a0b req-b5257b8b-2063-4e20-8cd2-ec09e548e4f8 tempest-TestMinimumBasicScenario-435940803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34" returned: 0 in 1.039s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-de8932c3-f36a-4fde-8ed8-ae1450cc7a0b req-b5257b8b-2063-4e20-8cd2-ec09e548e4f8 tempest-TestMinimumBasicScenario-435940803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.088s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-de8932c3-f36a-4fde-8ed8-ae1450cc7a0b req-b5257b8b-2063-4e20-8cd2-ec09e548e4f8 tempest-TestMinimumBasicScenario-435940803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed765afd-61f9-4996-bcd8-86e3b834711c', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:26:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-de8932c3-f36a-4fde-8ed8-ae1450cc7a0b req-b5257b8b-2063-4e20-8cd2-ec09e548e4f8 tempest-TestMinimumBasicScenario-435940803 None] attachment_update completed successfully. Jun 24 00:26:11 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD" returned: 0 in 0.912s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:11 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Temporary image f57f6d67-fa39-4fca-b804-ab80f4171967 is fetched for user 69c9c01465874c6aa735656720d5f87c. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:26:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bb2709-facb-4613-b48b-5a60d12734b5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:11 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD Jun 24 00:26:11 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:12 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD" returned: 0 in 0.850s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1377145416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c433a10f-0cef-41b4-a848-34a9d2822aa4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:26:10Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Creating volume c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:26:12 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:26:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:12 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 1073741824 Jun 24 00:26:12 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:13 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 1073741824" returned: 0 in 1.065s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:13 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 Jun 24 00:26:13 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:14 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4" returned: 0 in 0.824s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:26:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:14 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Attempting download of f57f6d67-fa39-4fca-b804-ab80f4171967 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}])) to volume c433a10f-0cef-41b4-a848-34a9d2822aa4. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:26:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7857f74-3314-44fc-b2a5-201c463d3345]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_uebl_r4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:14 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_uebl_r4e Jun 24 00:26:14 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:15 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_uebl_r4e" returned: 0 in 0.915s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_uebl_r4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:15 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_uebl_r4e Jun 24 00:26:15 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:16 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_uebl_r4e" returned: 1 in 1.111s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57f6d67-fa39-4fca-b804-ab80f4171967_uebl_r4e' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:26:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6960644d-ab21-405c-af80-191791cb6660]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:16 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD Jun 24 00:26:16 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:17 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD" returned: 0 in 1.242s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:17 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] f57f6d67-fa39-4fca-b804-ab80f4171967 was qcow2, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:26:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:17 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 Jun 24 00:26:17 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:20 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4" returned: 0 in 3.054s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:20 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57f6d67-fa39-4fca-b804-ab80f4171967_u7ikq853devstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:26:20 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Converted 112.00 MB image at 36.65 MB/s Jun 24 00:26:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:21 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 1G Jun 24 00:26:21 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:21 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 1G" returned: 0 in 0.874s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d58ac6-00bb-40c2-872f-5739915ec81b]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:22 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 Jun 24 00:26:22 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:22 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4" returned: 0 in 0.793s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:22 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 Jun 24 00:26:22 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:23 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4" returned: 1 in 0.906s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Downloaded image f57f6d67-fa39-4fca-b804-ab80f4171967 ((None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}])) to volume c433a10f-0cef-41b4-a848-34a9d2822aa4 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Temporary image f57f6d67-fa39-4fca-b804-ab80f4171967 for user 69c9c01465874c6aa735656720d5f87c is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Marking volume c433a10f-0cef-41b4-a848-34a9d2822aa4 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Copying metadata from image f57f6d67-fa39-4fca-b804-ab80f4171967 to c433a10f-0cef-41b4-a848-34a9d2822aa4. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Creating volume glance metadata for volume c433a10f-0cef-41b4-a848-34a9d2822aa4 backed by image f57f6d67-fa39-4fca-b804-ab80f4171967 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf264d4-07b1-4651-bb2a-d3aa4aee0d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c433a10f-0cef-41b4-a848-34a9d2822aa4', 'volume_size': 1, 'image_id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57f6d67-fa39-4fca-b804-ab80f4171967', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8f2caae145684586a2e20b34f271f7f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f57f6d67-fa39-4fca-b804-ab80f4171967', 'created_at': datetime.datetime(2026, 6, 23, 22, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 8, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57f6d67-fa39-4fca-b804-ab80f4171967/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3271ad-98f2-4796-82b9-369512521757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Volume volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 (c433a10f-0cef-41b4-a848-34a9d2822aa4): created successfully Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3271ad-98f2-4796-82b9-369512521757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (b47800a8-2642-4cf6-9e8c-0ea5c072a04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:26:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-94e90aa2-b20d-4d4d-afc9-5cb1eaa668b6 tempest-VolumesGetTest-1903838423 None] Created volume successfully. Jun 24 00:26:24 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (dd01711c-8a4d-43e3-8a25-b3d6a5bd6da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f94ee7-c36a-4a4d-9651-0b2ade2edc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f94ee7-c36a-4a4d-9651-0b2ade2edc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:26:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1022051504',display_name='tempest-VolumesGetTest-Volume-240519488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febd34de-8c14-449b-bbce-3c2ac27aec4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:26:25Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27472997-c8ad-4fc1-b0ce-5367fa9541ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27472997-c8ad-4fc1-b0ce-5367fa9541ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07223d0-ee39-4506-ae69-751e62fd6442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07223d0-ee39-4506-ae69-751e62fd6442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'febd34de-8c14-449b-bbce-3c2ac27aec4e', 'volume_name': 'volume-febd34de-8c14-449b-bbce-3c2ac27aec4e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89a47fb-598b-4841-918e-72e885fb39ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89a47fb-598b-4841-918e-72e885fb39ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49118c9e-ec30-45d6-ba7e-94dfc14b6184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Volume febd34de-8c14-449b-bbce-3c2ac27aec4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-febd34de-8c14-449b-bbce-3c2ac27aec4e', 'volume_size': 1} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:26:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1022051504',display_name='tempest-VolumesGetTest-Volume-240519488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febd34de-8c14-449b-bbce-3c2ac27aec4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf4a6c1ff1d414f802ba6a95709b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:26:25Z,use_quota=True,user_id='69c9c01465874c6aa735656720d5f87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Creating volume febd34de-8c14-449b-bbce-3c2ac27aec4e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:26:25 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:25 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e 1073741824 Jun 24 00:26:25 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:25 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e 1073741824" returned: 0 in 0.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:25 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e Jun 24 00:26:25 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:26 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e" returned: 0 in 0.681s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:26:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49118c9e-ec30-45d6-ba7e-94dfc14b6184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-febd34de-8c14-449b-bbce-3c2ac27aec4e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cc3d47-b4a5-4d27-900d-0bee8c6e763d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Volume volume-febd34de-8c14-449b-bbce-3c2ac27aec4e (febd34de-8c14-449b-bbce-3c2ac27aec4e): created successfully Jun 24 00:26:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cc3d47-b4a5-4d27-900d-0bee8c6e763d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Flow 'volume_create_manager' (dd01711c-8a4d-43e3-8a25-b3d6a5bd6da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:26:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2797243d-3723-4fcc-9316-a7862892fd2b tempest-VolumesGetTest-1903838423 None] Created volume successfully. Jun 24 00:26:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-febd34de-8c14-449b-bbce-3c2ac27aec4e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:26:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Lock "cinder-febd34de-8c14-449b-bbce-3c2ac27aec4e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:26:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-febd34de-8c14-449b-bbce-3c2ac27aec4e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:26:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-febd34de-8c14-449b-bbce-3c2ac27aec4e" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:26:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e5778-28e8-47da-835c-258407536e25]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:27 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e Jun 24 00:26:27 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:28 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e" returned: 0 in 0.849s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:28 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e Jun 24 00:26:28 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:28 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-febd34de-8c14-449b-bbce-3c2ac27aec4e" returned: 0 in 0.733s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-febd34de-8c14-449b-bbce-3c2ac27aec4e" released by "delete_volume" :: held 1.657s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Created reservations ['b6fbafdd-bccc-49a6-b6ea-a30bfccfc7c3', '407c0255-405b-4454-af46-753b3ae98fca', '66353bf7-68d9-4c50-8ba7-938cbf38a3d1', 'f9e1214d-b419-48ca-a5c6-675ab51b4c16'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:29 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:26:29 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-c433a10f-0cef-41b4-a848-34a9d2822aa4-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Lock "cinder-c433a10f-0cef-41b4-a848-34a9d2822aa4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Acquiring lock "cinder-quobyte-c433a10f-0cef-41b4-a848-34a9d2822aa4" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-c433a10f-0cef-41b4-a848-34a9d2822aa4" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c1ae5d-9b42-4111-97da-69ce4889d693]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:29 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.852s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:29 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:26:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Deleted volume successfully. Jun 24 00:26:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-14265e23-5996-4da6-8b4d-d097aa52bd3c tempest-VolumesGetTest-1903838423 None] Lock "cinder-febd34de-8c14-449b-bbce-3c2ac27aec4e-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:30 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 Jun 24 00:26:30 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:31 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4" returned: 0 in 1.087s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:31 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 Jun 24 00:26:31 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:32 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4" returned: 1 in 1.365s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:26:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:32 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4 Jun 24 00:26:32 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:33 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c433a10f-0cef-41b4-a848-34a9d2822aa4" returned: 0 in 0.858s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Lock "cinder-quobyte-c433a10f-0cef-41b4-a848-34a9d2822aa4" released by "delete_volume" :: held 3.424s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Created reservations ['e8b6da5d-cf68-42cd-98c2-ecfe18a04bb5', '43a1c188-2d16-493b-9754-abc0d9a05e58', '72f08507-eb29-47a7-99a4-4c1a0b1d1438', '079d0035-e9dc-44b0-be80-5d1f9a07581a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:33 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:26:33 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:34 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.484s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:34 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:26:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Deleted volume successfully. Jun 24 00:26:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c601c4fa-f1bf-41e5-89e4-ef8a631e3e34 tempest-VolumesGetTest-1903838423 None] Lock "cinder-c433a10f-0cef-41b4-a848-34a9d2822aa4-delete_volume" released by "delete_volume" :: held 5.368s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:26:38 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-13a39bfe-16ca-465b-9243-10683c5f51f4 req-aa222fef-cff1-4bf8-80be-a2b04e0cfc72 tempest-TestShelveInstance-1466731303 None] Terminate volume connection completed successfully. Jun 24 00:26:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-13a39bfe-16ca-465b-9243-10683c5f51f4 req-aa222fef-cff1-4bf8-80be-a2b04e0cfc72 tempest-TestShelveInstance-1466731303 None] Deleting attachment 3803e7d9-a1a9-425e-9407-4de6c54904d2. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:26:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:26:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:39 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:26:39 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:41 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 2.016s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:41 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:26:41 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:26:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:26:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:26:45 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=64,cinder:SELECT=54,cinder:INSERT=22,cinder:DELETE=7 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:26:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:46 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8213a69-1392-4485-bc7e-108669deae0e]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:46 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:26:46 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:47 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 0 in 0.839s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:47 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:26:47 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:48 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=66,cinder:SELECT=58,cinder:DELETE=4,cinder:INSERT=17 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:26:48 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 1 in 1.049s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:26:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.938s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bec0f97f-7ecb-43db-b6a5-6df4f202c0e9', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:26:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-0bd6bab1-54cc-48a4-a7a3-85f761e0dd3d req-aa042388-3d4d-4a0f-a307-8252c620ff3e tempest-TestShelveInstance-1466731303 None] attachment_update completed successfully. Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (d9558ff5-9e02-4989-bb90-3bfecd932e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94abba4-acaa-4a80-b2d1-fb76dabc1387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94abba4-acaa-4a80-b2d1-fb76dabc1387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1021886360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03740884-27ae-429d-ae13-0b56546ff34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f867873bc4d5b8d444f75dc002ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:26:56Z,use_quota=True,user_id='e3030383c89542aea2bd8d4f78e06f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9291c4f-f3e1-44ef-9b3f-c770130230ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9291c4f-f3e1-44ef-9b3f-c770130230ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d32a377-acbb-4a07-8ba0-4c697cde4d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d32a377-acbb-4a07-8ba0-4c697cde4d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03740884-27ae-429d-ae13-0b56546ff34a', 'volume_name': 'volume-03740884-27ae-429d-ae13-0b56546ff34a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1478ca11-af5b-400f-b2d9-c7b799f527a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1478ca11-af5b-400f-b2d9-c7b799f527a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f5f394-1799-4534-9b1e-21054030bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Volume 03740884-27ae-429d-ae13-0b56546ff34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03740884-27ae-429d-ae13-0b56546ff34a', 'volume_size': 1} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1021886360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03740884-27ae-429d-ae13-0b56546ff34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f867873bc4d5b8d444f75dc002ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:26:56Z,use_quota=True,user_id='e3030383c89542aea2bd8d4f78e06f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Creating volume 03740884-27ae-429d-ae13-0b56546ff34a {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:26:56 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:26:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:56 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a 1073741824 Jun 24 00:26:56 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:57 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a 1073741824" returned: 0 in 0.831s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:57 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a Jun 24 00:26:57 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:58 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a" returned: 0 in 0.656s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f5f394-1799-4534-9b1e-21054030bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03740884-27ae-429d-ae13-0b56546ff34a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1a9a78-6c8f-467f-a206-d2a40c1a38c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:26:58 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Volume volume-03740884-27ae-429d-ae13-0b56546ff34a (03740884-27ae-429d-ae13-0b56546ff34a): created successfully Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1a9a78-6c8f-467f-a206-d2a40c1a38c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (d9558ff5-9e02-4989-bb90-3bfecd932e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:26:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-66d08b48-6f98-413e-ac9a-6ba46117f700 tempest-VolumesSnapshotTestJSON-951302576 None] Created volume successfully. Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Creating offline snapshot 6d673931-ba0d-4dd9-912c-7064f2bbadee of volume 03740884-27ae-429d-ae13-0b56546ff34a {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2207b2-bfdb-4544-a82f-0cff7d9f75a7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:26:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:59 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a Jun 24 00:26:59 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:26:59 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jun 24 00:26:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a" returned: 0 in 0.892s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:26:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:26:59 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee 1G Jun 24 00:26:59 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:00 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee 1G" returned: 0 in 1.067s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03740884-27ae-429d-ae13-0b56546ff34a -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:00 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03740884-27ae-429d-ae13-0b56546ff34a -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee Jun 24 00:27:00 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:02 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03740884-27ae-429d-ae13-0b56546ff34a -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee" returned: 0 in 1.233s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:02 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee is being set with open permissions: ugo+rw Jun 24 00:27:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:02 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee Jun 24 00:27:02 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:03 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee" returned: 0 in 1.253s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:03 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.info Jun 24 00:27:03 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:04 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.info" returned: 0 in 0.895s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:04 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.info is being set with open permissions: ugo+rw Jun 24 00:27:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:04 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.info Jun 24 00:27:04 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:05 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.info" returned: 0 in 1.382s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.854s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-39663637-abce-40c8-8a5f-aeb8b5a0a1cf tempest-VolumesSnapshotTestJSON-951302576 None] Create snapshot completed successfully Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-6d673931-ba0d-4dd9-912c-7064f2bbadee-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-6d673931-ba0d-4dd9-912c-7064f2bbadee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-03740884-27ae-429d-ae13-0b56546ff34a" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-03740884-27ae-429d-ae13-0b56546ff34a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-6d673931-ba0d-4dd9-912c-7064f2bbadee" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-6d673931-ba0d-4dd9-912c-7064f2bbadee" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Deleting offline snapshot 6d673931-ba0d-4dd9-912c-7064f2bbadee of volume 03740884-27ae-429d-ae13-0b56546ff34a {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] snapshot_file for this snap is: volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b671592c-e8ff-4c81-82e3-c46b715bd368]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:06 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee Jun 24 00:27:06 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-bd7450b5-bf6f-4ee1-99f1-47b7032cc637 req-ecaef922-b39b-4335-b0d3-129e2828c07b tempest-TestMinimumBasicScenario-435940803 None] Terminate volume connection completed successfully. Jun 24 00:27:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bd7450b5-bf6f-4ee1-99f1-47b7032cc637 req-ecaef922-b39b-4335-b0d3-129e2828c07b tempest-TestMinimumBasicScenario-435940803 None] Deleting attachment ed765afd-61f9-4996-bcd8-86e3b834711c. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:27:07 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee" returned: 0 in 0.904s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03740884-27ae-429d-ae13-0b56546ff34a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:27:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f619b-169b-4a9b-b560-034ebf235b5f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:07 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a Jun 24 00:27:07 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:08 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a" returned: 0 in 0.957s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:08 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee Jun 24 00:27:08 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Acquiring lock "cinder-38e8d164-6e67-41b0-8e0b-f54b67f5af34-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Lock "cinder-38e8d164-6e67-41b0-8e0b-f54b67f5af34-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Acquiring lock "cinder-quobyte-38e8d164-6e67-41b0-8e0b-f54b67f5af34" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:09 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee" returned: 0 in 0.790s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Lock "cinder-quobyte-38e8d164-6e67-41b0-8e0b-f54b67f5af34" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:09 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee Jun 24 00:27:09 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b958af-98ec-402d-b39b-a27197c32755]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:09 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 Jun 24 00:27:09 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:10 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a.6d673931-ba0d-4dd9-912c-7064f2bbadee" returned: 0 in 0.752s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-6d673931-ba0d-4dd9-912c-7064f2bbadee" released by "_delete_snapshot" :: held 3.539s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-03740884-27ae-429d-ae13-0b56546ff34a" released by "delete_snapshot" :: held 3.579s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Created reservations ['64b03fd4-598a-43fd-ab71-2d9fe6c6ca7c', '149af13b-666a-4c59-b6c6-f21dfeea94bd', 'f749ca94-782c-4f2b-a2fd-95e64e050fce', '6ba934df-4611-48d7-b8cf-35fae475c53b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:27:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Delete snapshot completed successfully. Jun 24 00:27:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d39112-5743-430d-b2dc-78e0652992b2 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-6d673931-ba0d-4dd9-912c-7064f2bbadee-delete_snapshot" released by "delete_snapshot" :: held 3.856s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:10 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34" returned: 0 in 0.937s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:10 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34 Jun 24 00:27:10 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:11 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-38e8d164-6e67-41b0-8e0b-f54b67f5af34" returned: 0 in 0.817s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Lock "cinder-quobyte-38e8d164-6e67-41b0-8e0b-f54b67f5af34" released by "delete_volume" :: held 1.809s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Created reservations ['6a141e61-d0b3-40ca-8f7e-1f2a187e4183', 'c574c3be-0ed0-4f0e-8ce8-68b1f7d51f43', '21018f73-d005-454c-9fec-d4e7e412a8f1', '9a1fda3e-46b7-4004-ac5f-f248647e712d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:11 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:27:11 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (eccb0413-91a5-4943-a426-77d2d10c1687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd23c48-aa82-47e3-8b0e-a98e93a2d089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd23c48-aa82-47e3-8b0e-a98e93a2d089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-942929180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afda8bf7-4273-4dae-ae5d-f6b83272af48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f867873bc4d5b8d444f75dc002ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:27:12Z,use_quota=True,user_id='e3030383c89542aea2bd8d4f78e06f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96586da-1147-4521-98d6-1a09d6ee9b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96586da-1147-4521-98d6-1a09d6ee9b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8880fdf8-a147-45fc-a1fe-94a13ad29612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8880fdf8-a147-45fc-a1fe-94a13ad29612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afda8bf7-4273-4dae-ae5d-f6b83272af48', 'volume_name': 'volume-afda8bf7-4273-4dae-ae5d-f6b83272af48', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2abbbf7-c172-4f1d-a279-428045aa141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2abbbf7-c172-4f1d-a279-428045aa141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5988ed-2f58-4b42-a642-f6e1959d0259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Volume afda8bf7-4273-4dae-ae5d-f6b83272af48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afda8bf7-4273-4dae-ae5d-f6b83272af48', 'volume_size': 1} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-942929180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afda8bf7-4273-4dae-ae5d-f6b83272af48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f867873bc4d5b8d444f75dc002ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:27:12Z,use_quota=True,user_id='e3030383c89542aea2bd8d4f78e06f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Creating volume afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:27:11 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:27:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:11 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 1073741824 Jun 24 00:27:11 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:12 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.889s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:12 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:27:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Deleted volume successfully. Jun 24 00:27:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8fab4b30-8a79-4b39-aaf3-8b8e52ec6fdd tempest-TestMinimumBasicScenario-435940803 None] Lock "cinder-38e8d164-6e67-41b0-8e0b-f54b67f5af34-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:12 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 1073741824" returned: 0 in 1.016s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:12 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 Jun 24 00:27:12 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-4f909050-966d-4928-8eab-aa8245c17f19 req-b7273d62-05c4-450f-a9b5-3d887fe4b4d8 tempest-AttachVolumeNegativeTest-495043411 None] Terminate volume connection completed successfully. Jun 24 00:27:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-4f909050-966d-4928-8eab-aa8245c17f19 req-b7273d62-05c4-450f-a9b5-3d887fe4b4d8 tempest-AttachVolumeNegativeTest-495043411 None] Deleting attachment a31c3294-dd29-41e3-ba11-64da59fa0e63. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:27:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48" returned: 0 in 1.028s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:13 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:27:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5988ed-2f58-4b42-a642-f6e1959d0259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afda8bf7-4273-4dae-ae5d-f6b83272af48', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d8f56c-9594-4170-b618-03826d17bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Volume volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 (afda8bf7-4273-4dae-ae5d-f6b83272af48): created successfully Jun 24 00:27:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d8f56c-9594-4170-b618-03826d17bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (eccb0413-91a5-4943-a426-77d2d10c1687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:27:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0a3cb91c-ef08-4ab8-97b5-c9e1f6d679f5 tempest-VolumesSnapshotTestJSON-951302576 None] Created volume successfully. Jun 24 00:27:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Creating offline snapshot ba457291-1827-47da-8656-a213feb386a7 of volume afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:27:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3edc908-a0b5-4cca-b8cb-cc73de981105]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:15 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 Jun 24 00:27:15 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:16 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48" returned: 0 in 1.037s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:16 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 1G Jun 24 00:27:16 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:17 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 1G" returned: 0 in 1.616s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:17 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 Jun 24 00:27:17 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:19 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7" returned: 0 in 1.129s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:19 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 is being set with open permissions: ugo+rw Jun 24 00:27:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:19 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 Jun 24 00:27:19 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:19 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7" returned: 0 in 0.729s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:19 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.info Jun 24 00:27:19 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:20 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.info" returned: 0 in 0.796s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:20 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.info is being set with open permissions: ugo+rw Jun 24 00:27:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:20 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.info Jun 24 00:27:20 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:21 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.info" returned: 0 in 0.743s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.167s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-43e85911-09c2-4449-89af-0e32346d95bc tempest-VolumesSnapshotTestJSON-951302576 None] Create snapshot completed successfully Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (e0fe5a8b-cda6-453a-ab5e-e913995b4795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf0f3c1-1a1a-44ed-8450-1722a80a7e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf0f3c1-1a1a-44ed-8450-1722a80a7e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2048902050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc445a6a-b39a-411c-92bd-9044c1cc0ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f867873bc4d5b8d444f75dc002ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:27:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ba457291-1827-47da-8656-a213feb386a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:27:22Z,use_quota=True,user_id='e3030383c89542aea2bd8d4f78e06f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa0078c-bf69-4c4e-a6d8-f5454a72d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa0078c-bf69-4c4e-a6d8-f5454a72d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86673676-e350-4967-beb8-ee53f1c84e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86673676-e350-4967-beb8-ee53f1c84e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc445a6a-b39a-411c-92bd-9044c1cc0ef7', 'volume_name': 'volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7', 'volume_size': 2, 'snapshot_id': 'ba457291-1827-47da-8656-a213feb386a7'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a3f478-a67c-4977-87b1-a5fe95a2dcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a3f478-a67c-4977-87b1-a5fe95a2dcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11dd9607-957b-43aa-81d5-30731cf43aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Volume dc445a6a-b39a-411c-92bd-9044c1cc0ef7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7', 'volume_size': 2, 'snapshot_id': 'ba457291-1827-47da-8656-a213feb386a7'} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-ba457291-1827-47da-8656-a213feb386a7-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-ba457291-1827-47da-8656-a213feb386a7-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Creating volume dc445a6a-b39a-411c-92bd-9044c1cc0ef7 from snapshot ba457291-1827-47da-8656-a213feb386a7 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] snapshot: ba457291-1827-47da-8656-a213feb386a7, volume: dc445a6a-b39a-411c-92bd-9044c1cc0ef7, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a45bfa-a081-4094-8aea-caff1418fea0]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:22 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 Jun 24 00:27:22 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:23 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7" returned: 0 in 0.855s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afda8bf7-4273-4dae-ae5d-f6b83272af48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:27:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:27:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:27:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95e5b76-1f6d-44e5-b5b1-65f19cfd9e06]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:23 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 Jun 24 00:27:23 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:24 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48" returned: 0 in 0.903s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:24 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:27:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:24 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 Jun 24 00:27:24 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:30 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" returned: 0 in 6.366s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[981f7abe-fac1-43f3-8a32-0bbcd5e8a80c]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:30 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 Jun 24 00:27:30 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:31 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48" returned: 0 in 1.210s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:31 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:27:31 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Converted 1024.00 MB image at 160.82 MB/s Jun 24 00:27:31 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 is being set with open permissions: ugo+rw Jun 24 00:27:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:31 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 Jun 24 00:27:31 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:32 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=38,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=9 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:27:32 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=27,cinder:SELECT=31,cinder:INSERT=3,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:27:32 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" returned: 0 in 1.055s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" released by "_copy_volume_from_snapshot" :: held 10.525s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-ba457291-1827-47da-8656-a213feb386a7-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" released by "_create_volume_from_snapshot" :: held 10.571s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.586s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11dd9607-957b-43aa-81d5-30731cf43aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7', 'volume_size': 2, 'snapshot_id': 'ba457291-1827-47da-8656-a213feb386a7'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e1f304-8030-48ad-91f2-8ae57f9fc17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Volume volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 (dc445a6a-b39a-411c-92bd-9044c1cc0ef7): created successfully Jun 24 00:27:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e1f304-8030-48ad-91f2-8ae57f9fc17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (e0fe5a8b-cda6-453a-ab5e-e913995b4795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:27:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-168a96cf-d52a-4d87-9e7d-22aea938b815 tempest-VolumesSnapshotTestJSON-951302576 None] Created volume successfully. Jun 24 00:27:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-dc445a6a-b39a-411c-92bd-9044c1cc0ef7-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-dc445a6a-b39a-411c-92bd-9044c1cc0ef7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5462f0-c690-4a51-8dae-c658e704b9f4]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:33 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 Jun 24 00:27:33 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:34 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" returned: 0 in 0.899s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:34 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7 Jun 24 00:27:34 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-6e7d7170-ef6c-4495-a53c-1ef3bc6c2fa8 tempest-TestShelveInstance-1466731303 None] Terminate volume connection completed successfully. Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-6e7d7170-ef6c-4495-a53c-1ef3bc6c2fa8 tempest-TestShelveInstance-1466731303 None] Deleting attachment bec0f97f-7ecb-43db-b6a5-6df4f202c0e9. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:27:35 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" returned: 0 in 0.792s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-dc445a6a-b39a-411c-92bd-9044c1cc0ef7" released by "delete_volume" :: held 1.765s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Created reservations ['0ca3ccc0-75c3-4df5-93b4-42b06d4e51c1', '36a00694-687e-4974-b6cc-f0d06174bc83', '2fd99ef0-a15d-4958-bed4-3669105633da', 'aa648fdf-65a1-4d64-a789-680f9d28c6a6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:35 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:27:35 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Acquiring lock "cinder-3b0d24d2-cff5-428d-8ddf-823c2882d60b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Lock "cinder-3b0d24d2-cff5-428d-8ddf-823c2882d60b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-ba457291-1827-47da-8656-a213feb386a7-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-ba457291-1827-47da-8656-a213feb386a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-afda8bf7-4273-4dae-ae5d-f6b83272af48" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Acquiring lock "cinder-quobyte-3b0d24d2-cff5-428d-8ddf-823c2882d60b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-afda8bf7-4273-4dae-ae5d-f6b83272af48" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-ba457291-1827-47da-8656-a213feb386a7" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Lock "cinder-quobyte-3b0d24d2-cff5-428d-8ddf-823c2882d60b" acquired by "delete_volume" :: waited 0.067s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-ba457291-1827-47da-8656-a213feb386a7" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Deleting offline snapshot ba457291-1827-47da-8656-a213feb386a7 of volume afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] snapshot_file for this snap is: volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b18a1c5-21ca-498b-ae07-414ffd7ee3a1]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55015ba-09eb-447b-b301-dd8e733675ba]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:36 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:27:36 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:36 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 Jun 24 00:27:36 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:36 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.956s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:27:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Deleted volume successfully. Jun 24 00:27:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5d4fdce9-2640-4867-899a-5df9949af39c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-dc445a6a-b39a-411c-92bd-9044c1cc0ef7-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 0 in 1.017s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:37 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:37 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7" returned: 0 in 1.091s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afda8bf7-4273-4dae-ae5d-f6b83272af48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d020d24c-9faa-4272-821d-d737120ce893]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:37 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:27:37 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:37 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 Jun 24 00:27:37 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:37 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 1 in 0.840s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:27:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:37 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b Jun 24 00:27:37 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:38 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48" returned: 0 in 1.113s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:38 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 Jun 24 00:27:38 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:38 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-3b0d24d2-cff5-428d-8ddf-823c2882d60b" returned: 0 in 0.846s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Lock "cinder-quobyte-3b0d24d2-cff5-428d-8ddf-823c2882d60b" released by "delete_volume" :: held 2.798s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG cinder.quota [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Created reservations ['35da3d00-9bf6-4cdb-82e2-e332130b588b', 'f9bd3675-3e4f-4c02-b24e-f0c68914e410', 'd20d762f-cabb-4367-bae6-b97fc8a993a0', 'd7045dac-aa4d-47c1-ba7c-1ffc7f7f9e67'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:38 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:27:38 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:39 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7" returned: 0 in 0.905s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:39 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7 Jun 24 00:27:39 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:39 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:27:39 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:40 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.129s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.manager [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:27:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Deleted volume successfully. Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-df3618c0-2a13-4358-9144-b1dd5732f9a8 req-ef185007-4d95-467e-8e47-23bf4230f80d tempest-TestShelveInstance-1466731303 None] Lock "cinder-3b0d24d2-cff5-428d-8ddf-823c2882d60b-delete_volume" released by "delete_volume" :: held 4.311s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:40 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48.ba457291-1827-47da-8656-a213feb386a7" returned: 0 in 1.055s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-ba457291-1827-47da-8656-a213feb386a7" released by "_delete_snapshot" :: held 4.323s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-afda8bf7-4273-4dae-ae5d-f6b83272af48" released by "delete_snapshot" :: held 4.396s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Created reservations ['73511808-9d86-4d06-94b0-acbb567bf4d9', '91384bfa-6efa-481f-9af6-6a8a7feda652', 'a6d4c59d-8e89-41f6-b3e0-b7609b41d63f', 'b216a98e-6522-46d5-b81d-d4cd3a4b43fa'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:27:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Delete snapshot completed successfully. Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-79393aaa-30cc-4053-9782-92656f5940cb tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-ba457291-1827-47da-8656-a213feb386a7-delete_snapshot" released by "delete_snapshot" :: held 4.595s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:40 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.948s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:27:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:27:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-afda8bf7-4273-4dae-ae5d-f6b83272af48-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-afda8bf7-4273-4dae-ae5d-f6b83272af48-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-afda8bf7-4273-4dae-ae5d-f6b83272af48" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-afda8bf7-4273-4dae-ae5d-f6b83272af48" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85de268-3c33-4448-a169-af19f4c9c64a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:41 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 Jun 24 00:27:41 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:42 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48" returned: 0 in 0.869s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:42 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48 Jun 24 00:27:42 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:43 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afda8bf7-4273-4dae-ae5d-f6b83272af48" returned: 0 in 0.863s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-afda8bf7-4273-4dae-ae5d-f6b83272af48" released by "delete_volume" :: held 1.811s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Created reservations ['99dd9d84-2473-44a0-acbb-fe26eeae5cc4', '48907cbd-57dc-42b9-8ecd-5c1cd22b8ce1', '39b632a2-4807-4627-b3d4-1a7d279381b7', '3211e667-9938-4454-a09c-16144363e4ba'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:43 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:27:43 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:44 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.854s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:27:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Deleted volume successfully. Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ee5c29bd-f006-49d3-b69d-2a05b91a96a6 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-afda8bf7-4273-4dae-ae5d-f6b83272af48-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (01ddedb9-2b4e-46d2-b96b-1ac8feb4b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cbab12-3224-4b23-91c6-d7193c1dcd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cbab12-3224-4b23-91c6-d7193c1dcd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-847826038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaf04e7-a808-4323-bbe5-76aa8a118710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f867873bc4d5b8d444f75dc002ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:27:44Z,use_quota=True,user_id='e3030383c89542aea2bd8d4f78e06f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1851d02f-d5ab-4d64-ac3e-58d23e27bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1851d02f-d5ab-4d64-ac3e-58d23e27bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b278d5f-42f7-46cb-af4e-259a464f952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b278d5f-42f7-46cb-af4e-259a464f952e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afaf04e7-a808-4323-bbe5-76aa8a118710', 'volume_name': 'volume-afaf04e7-a808-4323-bbe5-76aa8a118710', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1163cfb0-06b7-464f-9820-7e6430012785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1163cfb0-06b7-464f-9820-7e6430012785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf64e59-8b92-4e56-af2c-8d4588e7504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Volume afaf04e7-a808-4323-bbe5-76aa8a118710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afaf04e7-a808-4323-bbe5-76aa8a118710', 'volume_size': 1} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-847826038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaf04e7-a808-4323-bbe5-76aa8a118710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f867873bc4d5b8d444f75dc002ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:27:44Z,use_quota=True,user_id='e3030383c89542aea2bd8d4f78e06f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Creating volume afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:27:44 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:27:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:44 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 1073741824 Jun 24 00:27:44 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 1073741824" returned: 0 in 1.046s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:45 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:45 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 Jun 24 00:27:45 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:46 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710" returned: 0 in 0.753s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:27:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf64e59-8b92-4e56-af2c-8d4588e7504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afaf04e7-a808-4323-bbe5-76aa8a118710', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62e3057-b0fd-4428-b041-8d0018c44e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:46 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Volume volume-afaf04e7-a808-4323-bbe5-76aa8a118710 (afaf04e7-a808-4323-bbe5-76aa8a118710): created successfully Jun 24 00:27:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62e3057-b0fd-4428-b041-8d0018c44e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (01ddedb9-2b4e-46d2-b96b-1ac8feb4b662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:27:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3e988e4f-b551-4b3c-bf9a-20c383924b5c tempest-VolumesSnapshotTestJSON-951302576 None] Created volume successfully. Jun 24 00:27:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Creating offline snapshot 6df96f1d-a28e-4024-a70e-4c25864684d9 of volume afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:27:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3ffca1-c35e-439d-88d2-2795624dba85]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:48 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 Jun 24 00:27:48 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:49 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710" returned: 0 in 1.101s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:49 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 1G Jun 24 00:27:49 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:50 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 1G" returned: 0 in 1.092s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afaf04e7-a808-4323-bbe5-76aa8a118710 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:50 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afaf04e7-a808-4323-bbe5-76aa8a118710 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 Jun 24 00:27:50 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:50 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afaf04e7-a808-4323-bbe5-76aa8a118710 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9" returned: 0 in 0.807s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:50 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 is being set with open permissions: ugo+rw Jun 24 00:27:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:51 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 Jun 24 00:27:51 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:51 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9" returned: 0 in 0.803s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:51 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.info Jun 24 00:27:51 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:52 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.info" returned: 0 in 0.759s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:52 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.info is being set with open permissions: ugo+rw Jun 24 00:27:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:52 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.info Jun 24 00:27:52 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:53 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.info" returned: 0 in 0.942s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.655s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7354315c-6614-4d3d-a104-f0775e5ce747 tempest-VolumesSnapshotTestJSON-951302576 None] Create snapshot completed successfully Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (34fdf2bf-d9df-4d8d-811a-26a41ed8efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5c47f8-4c3f-4392-9386-0247099afdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5c47f8-4c3f-4392-9386-0247099afdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1547615190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0271d6ef-a55a-415e-95b5-d1bcbc07eed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f867873bc4d5b8d444f75dc002ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6df96f1d-a28e-4024-a70e-4c25864684d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:27:55Z,use_quota=True,user_id='e3030383c89542aea2bd8d4f78e06f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e298a0-d646-460c-8054-43aba465440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e298a0-d646-460c-8054-43aba465440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1e5b5f-08cc-4885-b1f0-bac586ca08a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1e5b5f-08cc-4885-b1f0-bac586ca08a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0271d6ef-a55a-415e-95b5-d1bcbc07eed9', 'volume_name': 'volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9', 'volume_size': 1, 'snapshot_id': '6df96f1d-a28e-4024-a70e-4c25864684d9'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fd6316-4f70-4a1b-882c-ff9da5a0e783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:54 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fd6316-4f70-4a1b-882c-ff9da5a0e783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b5febd-6036-4eb2-a3d0-76a01f17c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:27:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Volume 0271d6ef-a55a-415e-95b5-d1bcbc07eed9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9', 'volume_size': 1, 'snapshot_id': '6df96f1d-a28e-4024-a70e-4c25864684d9'} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-6df96f1d-a28e-4024-a70e-4c25864684d9-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-6df96f1d-a28e-4024-a70e-4c25864684d9-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Creating volume 0271d6ef-a55a-415e-95b5-d1bcbc07eed9 from snapshot 6df96f1d-a28e-4024-a70e-4c25864684d9 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] snapshot: 6df96f1d-a28e-4024-a70e-4c25864684d9, volume: 0271d6ef-a55a-415e-95b5-d1bcbc07eed9, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dc70c2-6c2c-4618-b32d-2571550e1bd1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:55 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 Jun 24 00:27:55 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:56 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9" returned: 0 in 1.120s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afaf04e7-a808-4323-bbe5-76aa8a118710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:27:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:27:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:27:56 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18eb5ab-caf2-4f38-a0bb-84e47361fed2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:27:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:56 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 Jun 24 00:27:56 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:27:57 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jun 24 00:27:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710" returned: 0 in 1.118s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:27:57 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:27:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:27:57 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 Jun 24 00:27:57 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Flow 'volume_create_manager' (2cdf14ad-5645-41a7-818f-762e689844a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4d9f60-74c5-48e1-b10c-070244860c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4d9f60-74c5-48e1-b10c-070244860c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-197354388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11790b80-731a-421b-8098-ece03fe5be08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de7a9379a084b91bfb6ff496e185554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:06Z,use_quota=True,user_id='880318c0d72c4a9b88def6aeefce22ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd10cdea-5ffb-40b2-a204-67471a6aad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd10cdea-5ffb-40b2-a204-67471a6aad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c277e85b-324c-4a70-acfa-b935660ee5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c277e85b-324c-4a70-acfa-b935660ee5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11790b80-731a-421b-8098-ece03fe5be08', 'volume_name': 'volume-11790b80-731a-421b-8098-ece03fe5be08', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5143fef2-d294-4c02-adcc-ef5fe0446438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5143fef2-d294-4c02-adcc-ef5fe0446438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009a8ef8-4d51-4557-8714-c950e971c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Volume 11790b80-731a-421b-8098-ece03fe5be08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11790b80-731a-421b-8098-ece03fe5be08', 'volume_size': 1} Jun 24 00:28:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:07 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" returned: 0 in 9.795s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e9d479-6a9b-4fdf-8ffa-72264989e578]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:07 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 Jun 24 00:28:07 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:08 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710" returned: 0 in 1.389s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:08 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710, size 1024.00 MB, duration 9.80 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:28:08 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Converted 1024.00 MB image at 104.52 MB/s Jun 24 00:28:08 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 is being set with open permissions: ugo+rw Jun 24 00:28:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:08 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 Jun 24 00:28:08 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:09 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" returned: 0 in 0.835s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" released by "_copy_volume_from_snapshot" :: held 14.485s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-6df96f1d-a28e-4024-a70e-4c25864684d9-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" released by "_create_volume_from_snapshot" :: held 14.562s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.612s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.105s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-197354388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11790b80-731a-421b-8098-ece03fe5be08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de7a9379a084b91bfb6ff496e185554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:06Z,use_quota=True,user_id='880318c0d72c4a9b88def6aeefce22ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Creating volume 11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:28:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b5febd-6036-4eb2-a3d0-76a01f17c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9', 'volume_size': 1, 'snapshot_id': '6df96f1d-a28e-4024-a70e-4c25864684d9'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:09 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 1073741824 Jun 24 00:28:09 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8a8da8-8190-459e-9bf8-aaa580524ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Volume volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 (0271d6ef-a55a-415e-95b5-d1bcbc07eed9): created successfully Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8a8da8-8190-459e-9bf8-aaa580524ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Flow 'volume_create_manager' (34fdf2bf-d9df-4d8d-811a-26a41ed8efc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d68aa08b-88ae-45b8-ba2f-09832dfea5ec tempest-VolumesSnapshotTestJSON-951302576 None] Created volume successfully. Jun 24 00:28:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-0271d6ef-a55a-415e-95b5-d1bcbc07eed9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-0271d6ef-a55a-415e-95b5-d1bcbc07eed9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c9bd7-1889-494c-a634-94a62fada0a8]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:10 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:10 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 Jun 24 00:28:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 1073741824" returned: 0 in 1.184s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:10 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:10 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 Jun 24 00:28:10 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:11 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" returned: 0 in 1.012s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:11 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9 Jun 24 00:28:11 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:11 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08" returned: 0 in 0.911s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009a8ef8-4d51-4557-8714-c950e971c901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11790b80-731a-421b-8098-ece03fe5be08', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30aa6191-d67d-455a-b331-f15f44c8a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Volume volume-11790b80-731a-421b-8098-ece03fe5be08 (11790b80-731a-421b-8098-ece03fe5be08): created successfully Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30aa6191-d67d-455a-b331-f15f44c8a805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Flow 'volume_create_manager' (2cdf14ad-5645-41a7-818f-762e689844a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-de0113ef-f8dd-4c0f-8574-18617d7a7780 tempest-VolumeDependencyTests-229281875 None] Created volume successfully. Jun 24 00:28:12 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" returned: 0 in 0.777s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-0271d6ef-a55a-415e-95b5-d1bcbc07eed9" released by "delete_volume" :: held 1.837s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Created reservations ['bff810a1-4e83-43b7-99ca-beb9dd5f6bc1', 'b1b2dc72-4aed-4763-bf59-a26b4eed58b0', 'a6ae066a-5551-414f-beeb-d5d2e0549482', 'd21eb66c-807f-4285-b2e1-95eb7e616884'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Creating offline snapshot bd6585d9-580a-4c18-88d2-04f9a3c0b136 of volume 11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[68921716-9245-42a9-aa56-c6cb2b8c2791]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:12 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:28:12 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:12 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 Jun 24 00:28:12 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-6df96f1d-a28e-4024-a70e-4c25864684d9-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-6df96f1d-a28e-4024-a70e-4c25864684d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-afaf04e7-a808-4323-bbe5-76aa8a118710" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-afaf04e7-a808-4323-bbe5-76aa8a118710" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-6df96f1d-a28e-4024-a70e-4c25864684d9" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-6df96f1d-a28e-4024-a70e-4c25864684d9" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Deleting offline snapshot 6df96f1d-a28e-4024-a70e-4c25864684d9 of volume afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] snapshot_file for this snap is: volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3aee21-47f3-4eb6-8d1f-9f151ef4e68e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:13 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 Jun 24 00:28:13 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:13 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.093s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:28:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Deleted volume successfully. Jun 24 00:28:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2bacb206-3979-454a-985f-3ce6c171d08d tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-0271d6ef-a55a-415e-95b5-d1bcbc07eed9-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:14 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08" returned: 0 in 1.344s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:14 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 1G Jun 24 00:28:14 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:14 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9" returned: 0 in 1.039s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afaf04e7-a808-4323-bbe5-76aa8a118710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1d490-19b7-4409-8868-c58d00ccceb7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:14 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 Jun 24 00:28:14 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:14 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 1G" returned: 0 in 0.798s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11790b80-731a-421b-8098-ece03fe5be08 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:14 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11790b80-731a-421b-8098-ece03fe5be08 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 Jun 24 00:28:14 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:15 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710" returned: 0 in 0.826s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:15 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 Jun 24 00:28:15 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:15 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11790b80-731a-421b-8098-ece03fe5be08 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136" returned: 0 in 0.731s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:15 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 is being set with open permissions: ugo+rw Jun 24 00:28:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:15 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 Jun 24 00:28:15 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:15 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9" returned: 0 in 0.779s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:15 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9 Jun 24 00:28:15 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:16 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136" returned: 0 in 0.710s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:16 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.info Jun 24 00:28:16 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:16 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710.6df96f1d-a28e-4024-a70e-4c25864684d9" returned: 0 in 0.716s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-6df96f1d-a28e-4024-a70e-4c25864684d9" released by "_delete_snapshot" :: held 3.496s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-afaf04e7-a808-4323-bbe5-76aa8a118710" released by "delete_snapshot" :: held 3.543s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:16 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Created reservations ['f07c4daa-b6c4-45ce-9bb4-ded548028c47', 'b0f80200-72e5-4264-8181-71bc8f1a5fc1', 'ab3eebe5-9243-4062-8007-d9739dd1d47a', '20f6531d-b9e0-476c-b403-9225234bfc68'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Delete snapshot completed successfully. Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-54e92f6c-71c1-4de1-a98d-a92b1950fb76 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-6df96f1d-a28e-4024-a70e-4c25864684d9-delete_snapshot" released by "delete_snapshot" :: held 3.867s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:17 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.info" returned: 0 in 0.798s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:17 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.info is being set with open permissions: ugo+rw Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:17 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.info Jun 24 00:28:17 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-afaf04e7-a808-4323-bbe5-76aa8a118710-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-afaf04e7-a808-4323-bbe5-76aa8a118710-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-afaf04e7-a808-4323-bbe5-76aa8a118710" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-afaf04e7-a808-4323-bbe5-76aa8a118710" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98e0664-084e-46db-ae40-d41aad709a9e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:17 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 Jun 24 00:28:17 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:17 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.info" returned: 0 in 0.709s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.209s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-33d123a3-a540-40d2-8406-0bfc1d3f1e8d tempest-VolumeDependencyTests-229281875 None] Create snapshot completed successfully Jun 24 00:28:18 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710" returned: 0 in 0.835s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:18 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710 Jun 24 00:28:18 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:19 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-afaf04e7-a808-4323-bbe5-76aa8a118710" returned: 0 in 0.671s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-afaf04e7-a808-4323-bbe5-76aa8a118710" released by "delete_volume" :: held 1.597s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Created reservations ['0c817dd6-38e6-455a-90cf-1ec8307e21dc', '052a491f-a3cf-4a72-a0f2-b69a260fbc77', 'ca050eeb-e37c-4df7-ac8f-83129b99315d', '6f31d807-e606-4104-80e5-5e5a6d60d399'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:19 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:28:19 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Flow 'volume_create_manager' (aea5d047-e781-4b1b-afcd-812d5eac5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f153bbbf-974f-4587-a958-22920246a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f153bbbf-974f-4587-a958-22920246a727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1831100035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f8f66c-e39b-46cb-9532-3a915594b8f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de7a9379a084b91bfb6ff496e185554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd6585d9-580a-4c18-88d2-04f9a3c0b136,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:20Z,use_quota=True,user_id='880318c0d72c4a9b88def6aeefce22ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7b6754-34a3-4b98-b7f9-0ca5c5e30110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7b6754-34a3-4b98-b7f9-0ca5c5e30110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fa9a10-8525-42d4-8781-c8ae21f9f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fa9a10-8525-42d4-8781-c8ae21f9f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7f8f66c-e39b-46cb-9532-3a915594b8f5', 'volume_name': 'volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5', 'volume_size': 1, 'snapshot_id': 'bd6585d9-580a-4c18-88d2-04f9a3c0b136'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1d814c-ffd9-458e-99be-a46ba95ddbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1d814c-ffd9-458e-99be-a46ba95ddbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c847acd-232e-4033-a22c-cc1e319b8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Volume d7f8f66c-e39b-46cb-9532-3a915594b8f5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5', 'volume_size': 1, 'snapshot_id': 'bd6585d9-580a-4c18-88d2-04f9a3c0b136'} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-03740884-27ae-429d-ae13-0b56546ff34a-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-quobyte-bd6585d9-580a-4c18-88d2-04f9a3c0b136-d7f8f66c-e39b-46cb-9532-3a915594b8f5" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-03740884-27ae-429d-ae13-0b56546ff34a-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-bd6585d9-580a-4c18-88d2-04f9a3c0b136-d7f8f66c-e39b-46cb-9532-3a915594b8f5" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Creating volume d7f8f66c-e39b-46cb-9532-3a915594b8f5 from snapshot bd6585d9-580a-4c18-88d2-04f9a3c0b136 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-quobyte-d7f8f66c-e39b-46cb-9532-3a915594b8f5" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-d7f8f66c-e39b-46cb-9532-3a915594b8f5" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] snapshot: bd6585d9-580a-4c18-88d2-04f9a3c0b136, volume: d7f8f66c-e39b-46cb-9532-3a915594b8f5, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "cinder-quobyte-03740884-27ae-429d-ae13-0b56546ff34a" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-03740884-27ae-429d-ae13-0b56546ff34a" acquired by "delete_volume" :: waited 0.091s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[48815990-1681-422e-8385-373f69bf6826]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f37d6-45f7-4ef2-becb-a1c72edda3d4]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:20 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.950s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:28:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Deleted volume successfully. Jun 24 00:28:20 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 Jun 24 00:28:20 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:20 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a Jun 24 00:28:20 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-d70c803f-5e4a-4e84-ac3a-af2364e62594 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-afaf04e7-a808-4323-bbe5-76aa8a118710-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:21 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a" returned: 0 in 0.994s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:21 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136" returned: 0 in 1.043s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11790b80-731a-421b-8098-ece03fe5be08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:28:21 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2035d2f3-9b25-49be-8c13-09b49b5de799]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:21 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:21 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 Jun 24 00:28:21 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:21 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-03740884-27ae-429d-ae13-0b56546ff34a" returned: 0 in 0.707s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-quobyte-03740884-27ae-429d-ae13-0b56546ff34a" released by "delete_volume" :: held 1.804s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Created reservations ['60626b92-e687-4c87-b8d4-799ff9cdf343', '2b02f4b8-f74c-455a-90d6-c5abe2402c42', '3de2ec19-f675-49bd-b571-7ed0783ad3b3', '468dbcd4-1eb4-4de9-8435-96d5c3312ceb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:22 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08" returned: 0 in 0.839s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:22 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:28:22 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:22 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 Jun 24 00:28:22 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:22 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.751s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:28:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Deleted volume successfully. Jun 24 00:28:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-03bebba3-a9b8-42ab-9d0f-ac55c09e1611 tempest-VolumesSnapshotTestJSON-951302576 None] Lock "cinder-03740884-27ae-429d-ae13-0b56546ff34a-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Flow 'volume_create_manager' (823d4bf3-cd25-4420-aec5-a0d06665f5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387f5ca0-54b2-405b-8cc2-83d2abc573f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387f5ca0-54b2-405b-8cc2-83d2abc573f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-187987489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839a6a5b-653a-4f60-90e5-d7c42e5fc726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9a2907c9a44ae087dfe42472ebabf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:24Z,use_quota=True,user_id='248d0018694b4c8abd389ae5ca3ae6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce55c12-72b3-4064-8d13-b342f4f079ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce55c12-72b3-4064-8d13-b342f4f079ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb0e0d1-7812-47a3-83fc-2f635f31dbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb0e0d1-7812-47a3-83fc-2f635f31dbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839a6a5b-653a-4f60-90e5-d7c42e5fc726', 'volume_name': 'volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd34943c-3b01-43a0-b88e-8be165768147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd34943c-3b01-43a0-b88e-8be165768147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109724d6-5597-4eb6-85b5-c573fc4aaea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Volume 839a6a5b-653a-4f60-90e5-d7c42e5fc726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726', 'volume_size': 1} Jun 24 00:28:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5" returned: 0 in 7.525s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a0d132-3bea-481c-af23-a52b070270ed]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:29 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 Jun 24 00:28:29 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:30 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08" returned: 0 in 1.349s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:30 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:28:30 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Converted 1024.00 MB image at 136.05 MB/s Jun 24 00:28:30 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 is being set with open permissions: ugo+rw Jun 24 00:28:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:31 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 Jun 24 00:28:31 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:32 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5" returned: 0 in 1.211s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-d7f8f66c-e39b-46cb-9532-3a915594b8f5" released by "_copy_volume_from_snapshot" :: held 12.227s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-bd6585d9-580a-4c18-88d2-04f9a3c0b136-d7f8f66c-e39b-46cb-9532-3a915594b8f5" released by "_create_volume_from_snapshot" :: held 12.283s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.328s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.924s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-187987489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839a6a5b-653a-4f60-90e5-d7c42e5fc726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9a2907c9a44ae087dfe42472ebabf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:24Z,use_quota=True,user_id='248d0018694b4c8abd389ae5ca3ae6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Creating volume 839a6a5b-653a-4f60-90e5-d7c42e5fc726 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:28:32 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:32 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 1073741824 Jun 24 00:28:32 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c847acd-232e-4033-a22c-cc1e319b8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5', 'volume_size': 1, 'snapshot_id': 'bd6585d9-580a-4c18-88d2-04f9a3c0b136'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06379149-4feb-4b14-ab0e-c43b22b1b6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Volume volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 (d7f8f66c-e39b-46cb-9532-3a915594b8f5): created successfully Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06379149-4feb-4b14-ab0e-c43b22b1b6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Flow 'volume_create_manager' (aea5d047-e781-4b1b-afcd-812d5eac5e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-84a46df4-f4b0-4e6e-aafe-5d1dc04b4d82 tempest-VolumeDependencyTests-229281875 None] Created volume successfully. Jun 24 00:28:32 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=72,cinder:SELECT=58,cinder:INSERT=16,cinder:DELETE=9 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-bd6585d9-580a-4c18-88d2-04f9a3c0b136-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Lock "cinder-bd6585d9-580a-4c18-88d2-04f9a3c0b136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-quobyte-11790b80-731a-421b-8098-ece03fe5be08" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-11790b80-731a-421b-8098-ece03fe5be08" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-quobyte-bd6585d9-580a-4c18-88d2-04f9a3c0b136" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-bd6585d9-580a-4c18-88d2-04f9a3c0b136" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Deleting offline snapshot bd6585d9-580a-4c18-88d2-04f9a3c0b136 of volume 11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] snapshot_file for this snap is: volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[721d5111-ff3d-4bed-830f-b2da52c6135f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:33 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 1073741824" returned: 0 in 1.138s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=61,cinder:UPDATE=78,cinder:DELETE=4,cinder:INSERT=20 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:28:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:33 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 Jun 24 00:28:33 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:33 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 Jun 24 00:28:33 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:34 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726" returned: 0 in 0.764s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109724d6-5597-4eb6-85b5-c573fc4aaea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5027b7a0-2289-4091-a9f0-0a6208574f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Volume volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 (839a6a5b-653a-4f60-90e5-d7c42e5fc726): created successfully Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5027b7a0-2289-4091-a9f0-0a6208574f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Flow 'volume_create_manager' (823d4bf3-cd25-4420-aec5-a0d06665f5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-787bffcb-d2aa-4a41-bd15-d9b738ecffa2 tempest-AttachVolumeNegativeTest-495043411 None] Created volume successfully. Jun 24 00:28:34 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136" returned: 0 in 1.124s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11790b80-731a-421b-8098-ece03fe5be08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe0fe21-dcc4-4ec5-b63f-f25d324c079b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:34 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 Jun 24 00:28:34 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Flow 'volume_create_manager' (6695e985-54e9-4359-996f-321866e5cf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98094b6-2d42-4421-890a-dc919b54cab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98094b6-2d42-4421-890a-dc919b54cab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1136133034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba75075a-349f-423b-9195-7c65c3dee020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309aae2262d8486fb7ba4b40d74552cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:35Z,use_quota=True,user_id='41caff4bfa3749eea360102c112a20ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490edf78-6af3-498f-8001-371f5fd94bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490edf78-6af3-498f-8001-371f5fd94bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830ba027-e151-4334-b82c-adb22c38848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830ba027-e151-4334-b82c-adb22c38848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba75075a-349f-423b-9195-7c65c3dee020', 'volume_name': 'volume-ba75075a-349f-423b-9195-7c65c3dee020', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3135e9db-7958-486b-8bb3-c6f20f2ed909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3135e9db-7958-486b-8bb3-c6f20f2ed909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b37d188-3a62-4fd4-b22e-6f6ce04f5c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Volume ba75075a-349f-423b-9195-7c65c3dee020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba75075a-349f-423b-9195-7c65c3dee020', 'volume_size': 1} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1136133034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba75075a-349f-423b-9195-7c65c3dee020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309aae2262d8486fb7ba4b40d74552cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:35Z,use_quota=True,user_id='41caff4bfa3749eea360102c112a20ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Creating volume ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:28:35 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:35 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 1073741824 Jun 24 00:28:35 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:35 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08" returned: 0 in 0.901s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:35 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 Jun 24 00:28:35 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:36 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 1073741824" returned: 0 in 0.971s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:36 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 Jun 24 00:28:36 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:36 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136" returned: 0 in 0.818s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:36 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136 Jun 24 00:28:36 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:36 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020" returned: 0 in 0.627s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b37d188-3a62-4fd4-b22e-6f6ce04f5c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba75075a-349f-423b-9195-7c65c3dee020', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea594bb-a9e6-4291-aea1-7c0dc30494d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:36 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Volume volume-ba75075a-349f-423b-9195-7c65c3dee020 (ba75075a-349f-423b-9195-7c65c3dee020): created successfully Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea594bb-a9e6-4291-aea1-7c0dc30494d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Flow 'volume_create_manager' (6695e985-54e9-4359-996f-321866e5cf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-94499b38-50f1-40bf-9a52-9f79347de16e tempest-VolumesSnapshotListTestJSON-120055846 None] Created volume successfully. Jun 24 00:28:36 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08.bd6585d9-580a-4c18-88d2-04f9a3c0b136" returned: 0 in 0.695s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-bd6585d9-580a-4c18-88d2-04f9a3c0b136" released by "_delete_snapshot" :: held 3.673s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-11790b80-731a-421b-8098-ece03fe5be08" released by "delete_snapshot" :: held 3.713s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Created reservations ['ac096b8b-4408-4fce-af22-35a03b9555be', '02fcb710-7a25-463f-94bb-209bb5f0e1f4', '6ea4f216-5fc3-429e-922d-660735097ac7', '220de4b0-ec13-4bbb-bd71-73293449ceeb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Delete snapshot completed successfully. Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-41bbcc84-543c-46de-a64b-2337fd1ccc5f tempest-VolumeDependencyTests-229281875 None] Lock "cinder-bd6585d9-580a-4c18-88d2-04f9a3c0b136-delete_snapshot" released by "delete_snapshot" :: held 3.908s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Creating offline snapshot 26ef04ba-8145-4b2b-b53c-8ebc8b010c45 of volume ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea253704-2c1b-465d-831b-cabd42dae357]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:37 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 Jun 24 00:28:37 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-11790b80-731a-421b-8098-ece03fe5be08-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Lock "cinder-11790b80-731a-421b-8098-ece03fe5be08-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-quobyte-11790b80-731a-421b-8098-ece03fe5be08" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-11790b80-731a-421b-8098-ece03fe5be08" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fcbe27-241d-454f-b5c0-e9b96971c2d4]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:37 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 Jun 24 00:28:37 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:38 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020" returned: 0 in 0.911s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:38 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 1G Jun 24 00:28:38 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-8cacd1ac-1920-4959-af40-fee002d4540e req-13bd1cad-1d01-4f35-88dc-22f8ed4e7271 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:38 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08" returned: 0 in 0.887s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:38 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08 Jun 24 00:28:38 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:39 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 1G" returned: 0 in 0.864s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:39 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 Jun 24 00:28:39 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:39 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-11790b80-731a-421b-8098-ece03fe5be08" returned: 0 in 0.763s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-11790b80-731a-421b-8098-ece03fe5be08" released by "delete_volume" :: held 1.736s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Created reservations ['11302abf-4037-477a-8360-f42e39b5e834', '8eb59ae7-14a0-40d3-a4ef-ec8985a79780', '72992a2b-57ac-4d3a-a141-276f8d8ad680', '1e25462f-b685-4fa3-b744-6052ef3b686b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:39 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:28:39 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:39 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:28:39 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-d7f8f66c-e39b-46cb-9532-3a915594b8f5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Lock "cinder-d7f8f66c-e39b-46cb-9532-3a915594b8f5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Acquiring lock "cinder-quobyte-d7f8f66c-e39b-46cb-9532-3a915594b8f5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-d7f8f66c-e39b-46cb-9532-3a915594b8f5" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:40 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45" returned: 0 in 1.024s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:40 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 is being set with open permissions: ugo+rw Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4779c352-0e88-4c5e-8465-81624b56ed53]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:40 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 Jun 24 00:28:40 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:40 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 Jun 24 00:28:40 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:40 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.902s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:28:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Deleted volume successfully. Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4ab833ef-6921-41c3-b01b-94d7b0653364 tempest-VolumeDependencyTests-229281875 None] Lock "cinder-11790b80-731a-421b-8098-ece03fe5be08-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:40 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.926s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:28:40 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45" returned: 0 in 0.682s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:40 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.info Jun 24 00:28:40 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:41 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5" returned: 0 in 0.916s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:41 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5 Jun 24 00:28:41 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:41 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.info" returned: 0 in 0.686s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:41 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.info is being set with open permissions: ugo+rw Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:41 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.info Jun 24 00:28:41 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:41 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d7f8f66c-e39b-46cb-9532-3a915594b8f5" returned: 0 in 0.648s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Lock "cinder-quobyte-d7f8f66c-e39b-46cb-9532-3a915594b8f5" released by "delete_volume" :: held 1.660s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Created reservations ['5a914769-6a00-4af3-be55-b9ab9c28ba21', '71f3b705-c2c1-40be-b02b-3e919d38ef8e', '4cc12f67-03d1-4dc4-869d-e7258726349a', '4c84c73c-f73f-4755-b727-6c9868a9877f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:41 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:28:41 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:42 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.info" returned: 0 in 0.730s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.996s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-8cacd1ac-1920-4959-af40-fee002d4540e req-13bd1cad-1d01-4f35-88dc-22f8ed4e7271 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.995s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[15db439c-df68-44bc-a813-627ae022ced9]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-8cacd1ac-1920-4959-af40-fee002d4540e req-13bd1cad-1d01-4f35-88dc-22f8ed4e7271 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b35e3e15-4f9b-4698-829a-0382270a9a94 tempest-VolumesSnapshotListTestJSON-120055846 None] Create snapshot completed successfully Jun 24 00:28:42 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 Jun 24 00:28:42 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:42 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.691s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:28:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Deleted volume successfully. Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c99ae5c6-8d7d-4209-ac1c-d7201adc637c tempest-VolumeDependencyTests-229281875 None] Lock "cinder-d7f8f66c-e39b-46cb-9532-3a915594b8f5-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:43 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-8cacd1ac-1920-4959-af40-fee002d4540e req-13bd1cad-1d01-4f35-88dc-22f8ed4e7271 tempest-AttachVolumeNegativeTest-495043411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726" returned: 0 in 0.850s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-8cacd1ac-1920-4959-af40-fee002d4540e req-13bd1cad-1d01-4f35-88dc-22f8ed4e7271 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.874s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.435s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Creating offline snapshot 1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 of volume ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:28:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-8cacd1ac-1920-4959-af40-fee002d4540e req-13bd1cad-1d01-4f35-88dc-22f8ed4e7271 tempest-AttachVolumeNegativeTest-495043411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a92e1b2c-eb53-40a6-9067-e91b5fd15992', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:28:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e1436-0309-4f08-a4cf-6e8f8ea82c44]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-8cacd1ac-1920-4959-af40-fee002d4540e req-13bd1cad-1d01-4f35-88dc-22f8ed4e7271 tempest-AttachVolumeNegativeTest-495043411 None] attachment_update completed successfully. Jun 24 00:28:43 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 Jun 24 00:28:43 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:44 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45" returned: 0 in 0.866s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba75075a-349f-423b-9195-7c65c3dee020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:44 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 1G Jun 24 00:28:44 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:44 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 1G" returned: 0 in 0.872s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:44 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 Jun 24 00:28:44 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:45 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" returned: 0 in 0.689s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:45 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 is being set with open permissions: ugo+rw Jun 24 00:28:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:45 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 Jun 24 00:28:45 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:46 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" returned: 0 in 0.655s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.208s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bf688d3c-4b40-4578-aa9e-6f6c83a31399 tempest-VolumesSnapshotListTestJSON-120055846 None] Create snapshot completed successfully Jun 24 00:28:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Creating offline snapshot 25c45544-b8d5-4111-b7be-8f9f7b42c152 of volume ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:28:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[95220012-e448-4775-a7b0-c4862eeea486]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:47 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 Jun 24 00:28:47 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:47 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" returned: 0 in 0.784s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:47 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba75075a-349f-423b-9195-7c65c3dee020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:47 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 1G Jun 24 00:28:47 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:48 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 1G" returned: 0 in 0.875s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:48 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 Jun 24 00:28:48 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:49 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152" returned: 0 in 0.693s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:49 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 is being set with open permissions: ugo+rw Jun 24 00:28:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:49 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 Jun 24 00:28:49 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:49 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-e16d7f32-e32f-442a-b97d-f04ef24532eb req-9fe36282-2269-429d-97b4-1abc24754a05 tempest-AttachVolumeNegativeTest-495043411 None] Terminate volume connection completed successfully. Jun 24 00:28:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-e16d7f32-e32f-442a-b97d-f04ef24532eb req-9fe36282-2269-429d-97b4-1abc24754a05 tempest-AttachVolumeNegativeTest-495043411 None] Deleting attachment a92e1b2c-eb53-40a6-9067-e91b5fd15992. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:28:50 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152" returned: 0 in 0.632s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d47debc6-f70f-4a32-a013-523686c0beb7 tempest-VolumesSnapshotListTestJSON-120055846 None] Create snapshot completed successfully Jun 24 00:28:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-25c45544-b8d5-4111-b7be-8f9f7b42c152-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-25c45544-b8d5-4111-b7be-8f9f7b42c152-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-quobyte-25c45544-b8d5-4111-b7be-8f9f7b42c152" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-25c45544-b8d5-4111-b7be-8f9f7b42c152" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Deleting offline snapshot 25c45544-b8d5-4111-b7be-8f9f7b42c152 of volume ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:28:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] snapshot_file for this snap is: volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:28:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6975064b-6cef-4371-a191-e29ab700e84d]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:52 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 Jun 24 00:28:52 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:53 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152" returned: 0 in 0.997s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba75075a-349f-423b-9195-7c65c3dee020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66d8acb-84b1-47ed-9b0f-e84244cfddd7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Flow 'volume_create_manager' (3901a441-ff3d-49be-a783-9548cbbe253b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5b85e0-6979-4b8c-a3bd-6277e617ddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5b85e0-6979-4b8c-a3bd-6277e617ddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-51899250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f76a8f-0e09-4b67-8be1-aae5fe101b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8abd27e263a44f489c812a2ad84b1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:53Z,use_quota=True,user_id='cca62375aad445bc920ae69d4120cd40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe179da-b0cf-4205-bfe6-4083ead63e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:53 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe179da-b0cf-4205-bfe6-4083ead63e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:53 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730cd218-b031-4726-8553-28b76768a75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730cd218-b031-4726-8553-28b76768a75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f76a8f-0e09-4b67-8be1-aae5fe101b71', 'volume_name': 'volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab695402-bb61-4109-ab7e-9ec7d236763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab695402-bb61-4109-ab7e-9ec7d236763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae5d664-ee6d-4b42-b712-f013cd0ec5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Volume 43f76a8f-0e09-4b67-8be1-aae5fe101b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71', 'volume_size': 1} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-51899250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f76a8f-0e09-4b67-8be1-aae5fe101b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8abd27e263a44f489c812a2ad84b1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:28:53Z,use_quota=True,user_id='cca62375aad445bc920ae69d4120cd40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Creating volume 43f76a8f-0e09-4b67-8be1-aae5fe101b71 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:28:53 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:28:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:53 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 1073741824 Jun 24 00:28:53 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:54 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" returned: 0 in 0.905s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba75075a-349f-423b-9195-7c65c3dee020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:54 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 Jun 24 00:28:54 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:54 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 1073741824" returned: 0 in 0.993s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:54 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 Jun 24 00:28:54 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:55 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152" returned: 0 in 1.153s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:55 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152 Jun 24 00:28:55 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:55 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71" returned: 0 in 0.869s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae5d664-ee6d-4b42-b712-f013cd0ec5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48370398-28e6-4013-9ad9-ca494756f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:28:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Volume volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 (43f76a8f-0e09-4b67-8be1-aae5fe101b71): created successfully Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48370398-28e6-4013-9ad9-ca494756f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Flow 'volume_create_manager' (3901a441-ff3d-49be-a783-9548cbbe253b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:28:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7c28f3ea-f09a-44a9-a16e-0ba1619ffb3f tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Created volume successfully. Jun 24 00:28:55 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.25c45544-b8d5-4111-b7be-8f9f7b42c152" returned: 0 in 0.741s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-25c45544-b8d5-4111-b7be-8f9f7b42c152" released by "_delete_snapshot" :: held 3.940s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" released by "delete_snapshot" :: held 3.967s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Created reservations ['4388b6d0-c580-42cf-9d9b-61fe86d8c926', '29261eaf-33fd-4c6d-a399-f7e6feab6e4d', 'cfaa9459-629f-4b4f-a8a5-74a779e88c7b', 'adbc2e24-be68-403b-9876-92a1241d80f4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:56 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Delete snapshot completed successfully. Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c411fb08-756f-4ae3-886c-dd1cbfc4b823 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-25c45544-b8d5-4111-b7be-8f9f7b42c152-delete_snapshot" released by "delete_snapshot" :: held 4.131s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-quobyte-1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Deleting offline snapshot 1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 of volume ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] snapshot_file for this snap is: volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[847d897e-2bb8-450a-91dd-cc2a8f1aee09]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:56 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 Jun 24 00:28:56 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:57 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" returned: 0 in 0.839s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba75075a-349f-423b-9195-7c65c3dee020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:57 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fcd892-e51f-489c-aba9-ccf68abe1680]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:57 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 Jun 24 00:28:57 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:58 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45" returned: 0 in 0.810s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba75075a-349f-423b-9195-7c65c3dee020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:28:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:58 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 Jun 24 00:28:58 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:58 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" returned: 0 in 0.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:58 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150 Jun 24 00:28:58 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-314199cd-822c-47e6-9ae9-c93dd2838021 req-60c02154-8834-4c2f-a81c-2a7a51eed5ee tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-314199cd-822c-47e6-9ae9-c93dd2838021 req-60c02154-8834-4c2f-a81c-2a7a51eed5ee tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7cc93c-0455-40ad-91bf-a491f68c0437]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-314199cd-822c-47e6-9ae9-c93dd2838021 req-60c02154-8834-4c2f-a81c-2a7a51eed5ee tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:28:59 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 Jun 24 00:28:59 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:28:59 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" returned: 0 in 0.753s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150" released by "_delete_snapshot" :: held 3.362s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" released by "delete_snapshot" :: held 3.390s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Created reservations ['a56e137b-edbf-42a5-a7b2-ce9b6cb124cd', '170b6472-e065-40ba-90a7-277ec2703d81', 'c59e344e-b4f8-48a7-b6b4-a4280cbe670d', '3a7a7ba1-df4f-444c-adc3-7a2de98e4fec'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:28:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Delete snapshot completed successfully. Jun 24 00:28:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6879c54d-bcf9-4806-aa51-f6db31034a8a tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-1d6e2b26-a2f5-4ab7-99f1-fd8899c7e150-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:00 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-314199cd-822c-47e6-9ae9-c93dd2838021 req-60c02154-8834-4c2f-a81c-2a7a51eed5ee tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71" returned: 0 in 0.879s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-314199cd-822c-47e6-9ae9-c93dd2838021 req-60c02154-8834-4c2f-a81c-2a7a51eed5ee tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.917s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-314199cd-822c-47e6-9ae9-c93dd2838021 req-60c02154-8834-4c2f-a81c-2a7a51eed5ee tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54427be6-208c-44ae-b36a-f27ef6f845be', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:29:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-314199cd-822c-47e6-9ae9-c93dd2838021 req-60c02154-8834-4c2f-a81c-2a7a51eed5ee tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] attachment_update completed successfully. Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-26ef04ba-8145-4b2b-b53c-8ebc8b010c45-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-26ef04ba-8145-4b2b-b53c-8ebc8b010c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-quobyte-26ef04ba-8145-4b2b-b53c-8ebc8b010c45" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-26ef04ba-8145-4b2b-b53c-8ebc8b010c45" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Deleting offline snapshot 26ef04ba-8145-4b2b-b53c-8ebc8b010c45 of volume ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] snapshot_file for this snap is: volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[293c90be-d9a6-4cd0-8568-abff6aad9c89]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:00 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 Jun 24 00:29:00 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:01 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45" returned: 0 in 0.994s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba75075a-349f-423b-9195-7c65c3dee020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:29:01 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[be37ee40-7570-4527-bc23-07cc16aa5cfa]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:01 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 Jun 24 00:29:01 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:02 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020" returned: 0 in 0.863s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:02 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 Jun 24 00:29:02 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:03 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45" returned: 0 in 0.885s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:03 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45 Jun 24 00:29:03 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:04 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020.26ef04ba-8145-4b2b-b53c-8ebc8b010c45" returned: 0 in 0.693s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-26ef04ba-8145-4b2b-b53c-8ebc8b010c45" released by "_delete_snapshot" :: held 3.560s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" released by "delete_snapshot" :: held 3.581s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Created reservations ['a97e15ef-bd7b-4295-bbed-6dae21bde2e0', '72a74785-1e34-47f2-80cf-d82e89305304', 'c6c2f2ab-9567-44de-a2d3-10f146be1a50', '40cae392-535b-4581-832a-fd6e7afff505'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:29:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Delete snapshot completed successfully. Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9f4e905f-c0d1-469a-8050-4b746f0fa44e tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-26ef04ba-8145-4b2b-b53c-8ebc8b010c45-delete_snapshot" released by "delete_snapshot" :: held 3.729s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-ba75075a-349f-423b-9195-7c65c3dee020-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-ba75075a-349f-423b-9195-7c65c3dee020-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[570e1c4a-c325-4c97-949e-426f9eaba49f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:05 devstack sudo[109680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 Jun 24 00:29:05 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:05 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020" returned: 0 in 0.908s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:05 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020 Jun 24 00:29:05 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:06 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ba75075a-349f-423b-9195-7c65c3dee020" returned: 0 in 0.675s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-quobyte-ba75075a-349f-423b-9195-7c65c3dee020" released by "delete_volume" :: held 1.660s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Created reservations ['12316a83-052e-49e9-98a4-1bcae1237adb', '79c45419-510e-49a9-96b1-f3d9d94e35d9', '9daf3738-528c-4e84-9230-b63b603ea847', '060e4acd-7d5b-4967-95e4-8f92da5cb8e7'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:06 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:29:06 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:07 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.653s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:07 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:29:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Deleted volume successfully. Jun 24 00:29:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8ffbd703-4a72-4142-9595-64b2ffeed761 tempest-VolumesSnapshotListTestJSON-120055846 None] Lock "cinder-ba75075a-349f-423b-9195-7c65c3dee020-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-eb75d68c-4193-47f7-a621-de5202c33dcf req-dafc8e67-4d0b-4e18-919e-f1d3d671776c tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Terminate volume connection completed successfully. Jun 24 00:29:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-eb75d68c-4193-47f7-a621-de5202c33dcf req-dafc8e67-4d0b-4e18-919e-f1d3d671776c tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Deleting attachment 54427be6-208c-44ae-b36a-f27ef6f845be. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:29:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Acquiring lock "cinder-43f76a8f-0e09-4b67-8be1-aae5fe101b71-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "cinder-43f76a8f-0e09-4b67-8be1-aae5fe101b71-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Acquiring lock "cinder-quobyte-43f76a8f-0e09-4b67-8be1-aae5fe101b71" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "cinder-quobyte-43f76a8f-0e09-4b67-8be1-aae5fe101b71" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[da13b19e-77ce-47f2-95a7-7016f6bf9353]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:10 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 Jun 24 00:29:10 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:11 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71" returned: 0 in 0.836s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:11 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71 Jun 24 00:29:11 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:11 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-43f76a8f-0e09-4b67-8be1-aae5fe101b71" returned: 0 in 0.748s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "cinder-quobyte-43f76a8f-0e09-4b67-8be1-aae5fe101b71" released by "delete_volume" :: held 1.636s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Created reservations ['36f5f2fc-0be8-4015-99d9-5f910124123b', 'a01c9d54-87d2-46cd-bda0-5d2dba0344aa', '64f5810a-827b-4d07-94e9-8fe4473769d4', '33e77eaf-63f0-454d-896f-bffd95557391'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:12 devstack sudo[109775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:29:12 devstack sudo[109775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:12 devstack sudo[109775]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.968s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:12 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:29:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Deleted volume successfully. Jun 24 00:29:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bdb59576-4e3a-4b34-a1ad-4be84b4bded8 tempest-TestServerVolumeAttachScenarioOldVersion-346320 None] Lock "cinder-43f76a8f-0e09-4b67-8be1-aae5fe101b71-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Flow 'volume_create_manager' (1311cdbd-4b54-4931-9bd8-ef5f9e009815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b1e57b-bd8c-4ebf-bad7-acd284c9a674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b1e57b-bd8c-4ebf-bad7-acd284c9a674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ef3198-a9cb-407a-b8f5-f577699e68a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393c766cbfc04927b379534533600546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:14Z,use_quota=True,user_id='d17b12fa4f824d27875df4f5c1a00d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26b05b9e-2fb8-4340-8777-63558541610a),volume_type_id=26b05b9e-2fb8-4340-8777-63558541610a)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4496677e-d9c9-45e4-94e3-e37394b4e56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4496677e-d9c9-45e4-94e3-e37394b4e56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ac8706-eacf-421b-8910-8d5790283472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ac8706-eacf-421b-8910-8d5790283472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6ef3198-a9cb-407a-b8f5-f577699e68a8', 'volume_name': 'volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8', 'volume_size': 1, 'image_id': 'c5c26193-5f2a-415e-ae05-7c205996ce01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5c26193-5f2a-415e-ae05-7c205996ce01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0891595256c0fca7f6346e68e0433247', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '393c766cbfc04927b379534533600546', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '369ab2e1f9bc08e6ae36bc4114b69a481a193cc122fb2b93309b77938f14ffbbfbf00e215414ccb86a5b5a49331a9cff16dce576cebcec0d8898ecc4a7f6389c', 'id': 'c5c26193-5f2a-415e-ae05-7c205996ce01', 'created_at': datetime.datetime(2026, 6, 23, 22, 29, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5c26193-5f2a-415e-ae05-7c205996ce01/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd2f028-ca58-42bb-80ce-b65a7f6d966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd2f028-ca58-42bb-80ce-b65a7f6d966d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d4fc26-c315-40e0-85a9-8cad383df435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Volume c6ef3198-a9cb-407a-b8f5-f577699e68a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8', 'volume_size': 1, 'image_id': 'c5c26193-5f2a-415e-ae05-7c205996ce01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5c26193-5f2a-415e-ae05-7c205996ce01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0891595256c0fca7f6346e68e0433247', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '393c766cbfc04927b379534533600546', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '369ab2e1f9bc08e6ae36bc4114b69a481a193cc122fb2b93309b77938f14ffbbfbf00e215414ccb86a5b5a49331a9cff16dce576cebcec0d8898ecc4a7f6389c', 'id': 'c5c26193-5f2a-415e-ae05-7c205996ce01', 'created_at': datetime.datetime(2026, 6, 23, 22, 29, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5c26193-5f2a-415e-ae05-7c205996ce01/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Trying to clone c6ef3198-a9cb-407a-b8f5-f577699e68a8 from image c5c26193-5f2a-415e-ae05-7c205996ce01 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5c26193-5f2a-415e-ae05-7c205996ce01', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:29:14 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Image download 0.00 MB at 0.00 MB/s Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b60145c-1e59-42f8-84e3-c8627ba01742]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:14 devstack sudo[109836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD Jun 24 00:29:14 devstack sudo[109836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:15 devstack sudo[109836]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:15 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD Jun 24 00:29:15 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:16 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD" returned: 1 in 0.847s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:29:16 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Temporary image c5c26193-5f2a-415e-ae05-7c205996ce01 is fetched for user d17b12fa4f824d27875df4f5c1a00d6e. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:29:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bb7db3-d314-4934-85b2-6e298ff288a7]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:16 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD Jun 24 00:29:16 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:17 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:17 devstack sudo[109854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD Jun 24 00:29:17 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:17 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ef3198-a9cb-407a-b8f5-f577699e68a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393c766cbfc04927b379534533600546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:14Z,use_quota=True,user_id='d17b12fa4f824d27875df4f5c1a00d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26b05b9e-2fb8-4340-8777-63558541610a),volume_type_id=26b05b9e-2fb8-4340-8777-63558541610a)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Creating volume c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:17 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:17 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 1073741824 Jun 24 00:29:17 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:18 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 1073741824" returned: 0 in 0.859s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:18 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 Jun 24 00:29:18 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:19 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8" returned: 0 in 0.675s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:19 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Attempting download of c5c26193-5f2a-415e-ae05-7c205996ce01 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5c26193-5f2a-415e-ae05-7c205996ce01', 'metadata': {}}])) to volume c6ef3198-a9cb-407a-b8f5-f577699e68a8. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:29:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[70562dba-329e-44a2-aa10-c23efcff8b0d]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5c26193-5f2a-415e-ae05-7c205996ce01_1epn6aj5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:19 devstack sudo[109888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5c26193-5f2a-415e-ae05-7c205996ce01_1epn6aj5 Jun 24 00:29:19 devstack sudo[109888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:20 devstack sudo[109888]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5c26193-5f2a-415e-ae05-7c205996ce01_1epn6aj5" returned: 0 in 1.061s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5c26193-5f2a-415e-ae05-7c205996ce01_1epn6aj5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:20 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5c26193-5f2a-415e-ae05-7c205996ce01_1epn6aj5 Jun 24 00:29:20 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:21 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5c26193-5f2a-415e-ae05-7c205996ce01_1epn6aj5" returned: 1 in 0.921s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5c26193-5f2a-415e-ae05-7c205996ce01_1epn6aj5' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:29:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab24e79c-f575-4199-9d49-68842f7515f8]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:21 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD Jun 24 00:29:21 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:22 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD" returned: 0 in 1.019s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:22 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD Jun 24 00:29:22 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:23 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD" returned: 1 in 0.801s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:29:23 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] c5c26193-5f2a-415e-ae05-7c205996ce01 was raw, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:29:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:23 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 Jun 24 00:29:23 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:24 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8" returned: 0 in 0.856s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:24 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5c26193-5f2a-415e-ae05-7c205996ce01_8eq4hrwqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:29:24 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 00:29:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:24 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 1G Jun 24 00:29:24 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:24 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 1G" returned: 0 in 0.752s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6483b7c-e78a-42cf-895a-0ca787248233]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:25 devstack sudo[109984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 Jun 24 00:29:25 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:26 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8" returned: 0 in 1.154s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:26 devstack sudo[109991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 Jun 24 00:29:26 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:27 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8" returned: 1 in 1.075s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Downloaded image c5c26193-5f2a-415e-ae05-7c205996ce01 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5c26193-5f2a-415e-ae05-7c205996ce01', 'metadata': {}}])) to volume c6ef3198-a9cb-407a-b8f5-f577699e68a8 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Temporary image c5c26193-5f2a-415e-ae05-7c205996ce01 for user d17b12fa4f824d27875df4f5c1a00d6e is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Marking volume c6ef3198-a9cb-407a-b8f5-f577699e68a8 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Copying metadata from image c5c26193-5f2a-415e-ae05-7c205996ce01 to c6ef3198-a9cb-407a-b8f5-f577699e68a8. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Creating volume glance metadata for volume c6ef3198-a9cb-407a-b8f5-f577699e68a8 backed by image c5c26193-5f2a-415e-ae05-7c205996ce01 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c5c26193-5f2a-415e-ae05-7c205996ce01', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0891595256c0fca7f6346e68e0433247', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d4fc26-c315-40e0-85a9-8cad383df435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8', 'volume_size': 1, 'image_id': 'c5c26193-5f2a-415e-ae05-7c205996ce01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5c26193-5f2a-415e-ae05-7c205996ce01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0891595256c0fca7f6346e68e0433247', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '393c766cbfc04927b379534533600546', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '369ab2e1f9bc08e6ae36bc4114b69a481a193cc122fb2b93309b77938f14ffbbfbf00e215414ccb86a5b5a49331a9cff16dce576cebcec0d8898ecc4a7f6389c', 'id': 'c5c26193-5f2a-415e-ae05-7c205996ce01', 'created_at': datetime.datetime(2026, 6, 23, 22, 29, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 29, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5c26193-5f2a-415e-ae05-7c205996ce01/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9687cc64-b85a-4f2c-97bc-038733f958a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Volume volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 (c6ef3198-a9cb-407a-b8f5-f577699e68a8): created successfully Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9687cc64-b85a-4f2c-97bc-038733f958a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Flow 'volume_create_manager' (1311cdbd-4b54-4931-9bd8-ef5f9e009815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0908e090-9db9-4b6d-a7c3-20f316d6ec99 tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Created volume successfully. Jun 24 00:29:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Acquiring lock "cinder-c6ef3198-a9cb-407a-b8f5-f577699e68a8-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "cinder-c6ef3198-a9cb-407a-b8f5-f577699e68a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Acquiring lock "cinder-quobyte-c6ef3198-a9cb-407a-b8f5-f577699e68a8" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "cinder-quobyte-c6ef3198-a9cb-407a-b8f5-f577699e68a8" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:28 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fd4a75-c8f0-441a-8292-394be468b873]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:28 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 Jun 24 00:29:28 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:29 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8" returned: 0 in 0.924s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:29 devstack sudo[110004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 Jun 24 00:29:29 devstack sudo[110004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:30 devstack sudo[110004]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8" returned: 1 in 0.995s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:29:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:30 devstack sudo[110009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8 Jun 24 00:29:30 devstack sudo[110009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:31 devstack sudo[110009]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c6ef3198-a9cb-407a-b8f5-f577699e68a8" returned: 0 in 0.728s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "cinder-quobyte-c6ef3198-a9cb-407a-b8f5-f577699e68a8" released by "delete_volume" :: held 2.731s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:31 devstack cinder-volume[94472]: WARNING cinder.quota [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:29:31 devstack cinder-volume[94472]: WARNING cinder.quota [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Created reservations ['ba02b762-b401-4da3-84eb-8b66d8c5abd4', 'f5e7c56d-74a1-49a7-b463-bff422d24dc5', 'df3f0257-c609-48ab-829f-b647dcef7cd8', 'a2c5032b-8134-4527-a71f-7872b3a4886c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:31 devstack sudo[110013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:29:31 devstack sudo[110013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:32 devstack sudo[110013]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.845s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:32 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:29:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Deleted volume successfully. Jun 24 00:29:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-26d52c4a-1707-42e6-a43e-e6ce8c8f758e tempest-VolumeAndVolumeTypeFromImageTest-1727568958 None] Lock "cinder-c6ef3198-a9cb-407a-b8f5-f577699e68a8-delete_volume" released by "delete_volume" :: held 3.901s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=80,cinder:DELETE=6,cinder:SELECT=76,cinder:INSERT=23 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=76,cinder:INSERT=28,cinder:UPDATE=83,cinder:DELETE=6 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (4671d29e-e5d2-415f-ba95-a56f44418c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d74468-9baa-45d5-a670-9f7a0fdc33db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d74468-9baa-45d5-a670-9f7a0fdc33db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-625957831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5254b59c-2bcf-485b-93c8-dfaf9c2dce50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:37Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe516a8-ad9a-4e4c-af29-6bfa393a50b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe516a8-ad9a-4e4c-af29-6bfa393a50b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9cb157-43b7-4a5e-a389-396d99868c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9cb157-43b7-4a5e-a389-396d99868c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5254b59c-2bcf-485b-93c8-dfaf9c2dce50', 'volume_name': 'volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84658a8-5348-4b2f-9252-c24b94145abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84658a8-5348-4b2f-9252-c24b94145abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d675c034-e2ef-4f80-98ba-82df59351af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Volume 5254b59c-2bcf-485b-93c8-dfaf9c2dce50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50', 'volume_size': 1} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-625957831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5254b59c-2bcf-485b-93c8-dfaf9c2dce50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:37Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Creating volume 5254b59c-2bcf-485b-93c8-dfaf9c2dce50 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:37 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:37 devstack sudo[110029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 1073741824 Jun 24 00:29:37 devstack sudo[110029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (a9f7d3d5-59eb-41c6-9e21-7daf23a1e53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82615241-1d27-467c-bd74-610c05296306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82615241-1d27-467c-bd74-610c05296306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1064922668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06934192-a0d3-435b-a3e6-fc8ea1912e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:38Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5ff33d-0057-4c5b-b71d-edbd4fcee3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5ff33d-0057-4c5b-b71d-edbd4fcee3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8c546c-352c-443a-be9e-aa00fba2fa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8c546c-352c-443a-be9e-aa00fba2fa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06934192-a0d3-435b-a3e6-fc8ea1912e8b', 'volume_name': 'volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bd9760-56ec-4310-b904-ba7d9d8ef24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bd9760-56ec-4310-b904-ba7d9d8ef24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a007cf32-a05c-4049-b41d-55e335f414e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:37 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Volume 06934192-a0d3-435b-a3e6-fc8ea1912e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b', 'volume_size': 1} Jun 24 00:29:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (e0fd9a95-c2be-46c9-bbc0-f854d4e17101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e99852-df9a-4913-8cec-98b0b91642d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e99852-df9a-4913-8cec-98b0b91642d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901660269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89a147b-ac43-4c85-b984-60e560e265b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:38Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0a007d-ef0c-4f6c-a57a-ba1d750a590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0a007d-ef0c-4f6c-a57a-ba1d750a590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b065522-5f68-440c-aad1-82b2bddba3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b065522-5f68-440c-aad1-82b2bddba3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd89a147b-ac43-4c85-b984-60e560e265b9', 'volume_name': 'volume-d89a147b-ac43-4c85-b984-60e560e265b9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d384e1-b02d-48a7-b2dd-9149417cb125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d384e1-b02d-48a7-b2dd-9149417cb125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58eda87-241a-41cd-91a2-b28e825d42f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Volume d89a147b-ac43-4c85-b984-60e560e265b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d89a147b-ac43-4c85-b984-60e560e265b9', 'volume_size': 1} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:38 devstack sudo[110029]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 1073741824" returned: 0 in 1.095s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:38 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 Jun 24 00:29:38 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (c80b0183-dc4d-49bb-86dd-5adbf65e800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c337d4e5-c4f1-4b68-984e-15633b2f7d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c337d4e5-c4f1-4b68-984e-15633b2f7d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-657627479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6adca9ff-f7e6-4a03-a454-8ed52bacb431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:38Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28be0f47-dbf5-41ac-8b03-e77cac167ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28be0f47-dbf5-41ac-8b03-e77cac167ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444ac871-bfb4-479e-87bf-774e95fb54be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444ac871-bfb4-479e-87bf-774e95fb54be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6adca9ff-f7e6-4a03-a454-8ed52bacb431', 'volume_name': 'volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192fc56d-ee33-4402-95cc-250e10a44fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192fc56d-ee33-4402-95cc-250e10a44fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db9ed77-c0e1-43c1-b40b-460705389e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Volume 6adca9ff-f7e6-4a03-a454-8ed52bacb431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431', 'volume_size': 1} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (861a891f-2ea6-4fb3-b342-cff9c3a1ccfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4729ef1f-de2e-4894-b18e-bbce2b6da4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4729ef1f-de2e-4894-b18e-bbce2b6da4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2077952326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44fd86a-8f8f-4181-890c-7fee16167ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:39Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd0d112-76a5-4369-9dc6-d33250889f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd0d112-76a5-4369-9dc6-d33250889f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c71ad7-aa10-4711-b55c-5de61a4dc584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c71ad7-aa10-4711-b55c-5de61a4dc584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e44fd86a-8f8f-4181-890c-7fee16167ebd', 'volume_name': 'volume-e44fd86a-8f8f-4181-890c-7fee16167ebd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28efdce3-e679-4e3f-90d8-92d4d5d9aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28efdce3-e679-4e3f-90d8-92d4d5d9aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ace2eec-418f-4082-9d40-0e66902741b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:38 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Volume e44fd86a-8f8f-4181-890c-7fee16167ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e44fd86a-8f8f-4181-890c-7fee16167ebd', 'volume_size': 1} Jun 24 00:29:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:39 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50" returned: 0 in 0.820s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.499s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1064922668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06934192-a0d3-435b-a3e6-fc8ea1912e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:38Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Creating volume 06934192-a0d3-435b-a3e6-fc8ea1912e8b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:39 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d675c034-e2ef-4f80-98ba-82df59351af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:39 devstack sudo[110038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b 1073741824 Jun 24 00:29:39 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c49a611-8bff-4c75-a9e8-1907cb423fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:39 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Volume volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 (5254b59c-2bcf-485b-93c8-dfaf9c2dce50): created successfully Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c49a611-8bff-4c75-a9e8-1907cb423fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (4671d29e-e5d2-415f-ba95-a56f44418c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:39 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6703c510-eee4-4511-ac2c-3520e4a1e883 tempest-CreateVolumesFromImageTest-401003865 None] Created volume successfully. Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:39 devstack sudo[110040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:29:39 devstack sudo[110040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:40 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b 1073741824" returned: 0 in 1.007s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:40 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b Jun 24 00:29:40 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:40 devstack sudo[110040]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.961s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:29:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:29:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:29:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:29:41 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b" returned: 0 in 0.948s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901660269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89a147b-ac43-4c85-b984-60e560e265b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:38Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Creating volume d89a147b-ac43-4c85-b984-60e560e265b9 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:41 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:41 devstack sudo[110050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 1073741824 Jun 24 00:29:41 devstack sudo[110050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a007cf32-a05c-4049-b41d-55e335f414e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b65a0b-3335-4a9f-b8aa-b2571a3e03b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:41 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Volume volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b (06934192-a0d3-435b-a3e6-fc8ea1912e8b): created successfully Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b65a0b-3335-4a9f-b8aa-b2571a3e03b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:41 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (a9f7d3d5-59eb-41c6-9e21-7daf23a1e53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f5342268-fa13-43a4-9d86-00d579220140 tempest-CreateVolumesFromImageTest-401003865 None] Created volume successfully. Jun 24 00:29:42 devstack sudo[110050]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 1073741824" returned: 0 in 0.880s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:42 devstack sudo[110062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 Jun 24 00:29:42 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:42 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9" returned: 0 in 0.817s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.389s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-657627479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6adca9ff-f7e6-4a03-a454-8ed52bacb431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:38Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Creating volume 6adca9ff-f7e6-4a03-a454-8ed52bacb431 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:42 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:43 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 1073741824 Jun 24 00:29:43 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58eda87-241a-41cd-91a2-b28e825d42f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89a147b-ac43-4c85-b984-60e560e265b9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306df5e7-dd7b-4b71-a085-5bfce8d7868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Volume volume-d89a147b-ac43-4c85-b984-60e560e265b9 (d89a147b-ac43-4c85-b984-60e560e265b9): created successfully Jun 24 00:29:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306df5e7-dd7b-4b71-a085-5bfce8d7868a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (e0fd9a95-c2be-46c9-bbc0-f854d4e17101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fc5e9a1c-3226-4540-b76c-a280f8c0cfaf tempest-CreateVolumesFromImageTest-401003865 None] Created volume successfully. Jun 24 00:29:43 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 1073741824" returned: 0 in 0.959s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:44 devstack sudo[110070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 Jun 24 00:29:44 devstack sudo[110070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:44 devstack sudo[110070]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431" returned: 0 in 0.836s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.849s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2077952326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44fd86a-8f8f-4181-890c-7fee16167ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5ad8044ca141a89c08c42941cd3795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:39Z,use_quota=True,user_id='04add363f12e43b98c5c51d541d4ba15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Creating volume e44fd86a-8f8f-4181-890c-7fee16167ebd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:44 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:44 devstack sudo[110073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd 1073741824 Jun 24 00:29:44 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db9ed77-c0e1-43c1-b40b-460705389e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d3ec79-00cd-4645-95e8-af97a66ec6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Volume volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 (6adca9ff-f7e6-4a03-a454-8ed52bacb431): created successfully Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d3ec79-00cd-4645-95e8-af97a66ec6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (c80b0183-dc4d-49bb-86dd-5adbf65e800b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0b55c898-a0ba-41d9-9249-838d3a119d9a tempest-CreateVolumesFromImageTest-401003865 None] Created volume successfully. Jun 24 00:29:45 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd 1073741824" returned: 0 in 0.877s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:45 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd Jun 24 00:29:45 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:46 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd" returned: 0 in 0.817s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ace2eec-418f-4082-9d40-0e66902741b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44fd86a-8f8f-4181-890c-7fee16167ebd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daf1aa5-e35c-4f54-8f51-e002a0ddc9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:46 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Volume volume-e44fd86a-8f8f-4181-890c-7fee16167ebd (e44fd86a-8f8f-4181-890c-7fee16167ebd): created successfully Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daf1aa5-e35c-4f54-8f51-e002a0ddc9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Flow 'volume_create_manager' (861a891f-2ea6-4fb3-b342-cff9c3a1ccfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7156ff30-8431-4e5b-add9-e106d0363ef4 tempest-CreateVolumesFromImageTest-401003865 None] Created volume successfully. Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Flow 'volume_create_manager' (80990082-13b2-4b9e-b596-e28d49f5f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d34bfce-39cf-4198-a0a2-92b209d37748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d34bfce-39cf-4198-a0a2-92b209d37748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-274998981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeafa16-fa36-4efc-8e34-e14f9e5e010f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9a2907c9a44ae087dfe42472ebabf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:47Z,use_quota=True,user_id='248d0018694b4c8abd389ae5ca3ae6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e625c4d-41f6-4385-bf5b-cce6770ff973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e625c4d-41f6-4385-bf5b-cce6770ff973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb07a271-aeb9-4953-826b-9956efd67871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb07a271-aeb9-4953-826b-9956efd67871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eeafa16-fa36-4efc-8e34-e14f9e5e010f', 'volume_name': 'volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782759a4-d551-4b67-91e1-7c2a30d16c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782759a4-d551-4b67-91e1-7c2a30d16c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dd2cd3-a680-48d2-975f-7c6c0132ad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:46 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Volume 0eeafa16-fa36-4efc-8e34-e14f9e5e010f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f', 'volume_size': 1} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-274998981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeafa16-fa36-4efc-8e34-e14f9e5e010f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9a2907c9a44ae087dfe42472ebabf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:47Z,use_quota=True,user_id='248d0018694b4c8abd389ae5ca3ae6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Creating volume 0eeafa16-fa36-4efc-8e34-e14f9e5e010f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:46 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:46 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f 1073741824 Jun 24 00:29:46 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:47 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f 1073741824" returned: 0 in 0.878s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:47 devstack sudo[110091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f Jun 24 00:29:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-e44fd86a-8f8f-4181-890c-7fee16167ebd-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:47 devstack sudo[110091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-e44fd86a-8f8f-4181-890c-7fee16167ebd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-quobyte-e44fd86a-8f8f-4181-890c-7fee16167ebd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-e44fd86a-8f8f-4181-890c-7fee16167ebd" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:47 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a6144-0db5-403b-8396-365a1f7b80b7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:48 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd Jun 24 00:29:48 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:48 devstack sudo[110091]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f" returned: 0 in 0.716s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dd2cd3-a680-48d2-975f-7c6c0132ad17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89da47a-1ef4-4602-994d-d0e9a4bdf20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:48 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Volume volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f (0eeafa16-fa36-4efc-8e34-e14f9e5e010f): created successfully Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89da47a-1ef4-4602-994d-d0e9a4bdf20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Flow 'volume_create_manager' (80990082-13b2-4b9e-b596-e28d49f5f372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:48 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fa344ebc-1f52-4f8f-b155-78e3b087c3ab tempest-AttachVolumeNegativeTest-495043411 None] Created volume successfully. Jun 24 00:29:48 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd" returned: 0 in 0.826s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:48 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:48 devstack sudo[110100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd Jun 24 00:29:48 devstack sudo[110100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:49 devstack sudo[110100]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e44fd86a-8f8f-4181-890c-7fee16167ebd" returned: 0 in 0.848s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-e44fd86a-8f8f-4181-890c-7fee16167ebd" released by "delete_volume" :: held 1.721s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Created reservations ['a3e6e3fc-6cc1-4435-aba4-c26416409b17', '05477576-4bb2-4b63-8b7a-6b59e4ddac19', 'dc914dcc-057c-4a85-b896-bfa0e4aa2007', '1872e619-c97e-4425-9bd1-a3c0e270fd93'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:49 devstack sudo[110106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:29:49 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-6adca9ff-f7e6-4a03-a454-8ed52bacb431-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-6adca9ff-f7e6-4a03-a454-8ed52bacb431-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-quobyte-6adca9ff-f7e6-4a03-a454-8ed52bacb431" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-6adca9ff-f7e6-4a03-a454-8ed52bacb431" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb05802-5302-4e66-b4bd-6df778e3e396]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:50 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 Jun 24 00:29:50 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:50 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.888s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:29:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Deleted volume successfully. Jun 24 00:29:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e72ee90d-5e50-43f9-8a04-f8fd3947ad11 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-e44fd86a-8f8f-4181-890c-7fee16167ebd-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:51 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431" returned: 0 in 1.055s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:51 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431 Jun 24 00:29:51 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:52 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6adca9ff-f7e6-4a03-a454-8ed52bacb431" returned: 0 in 0.831s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-6adca9ff-f7e6-4a03-a454-8ed52bacb431" released by "delete_volume" :: held 1.974s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Created reservations ['9a7d99c6-2158-4ac5-953e-fd08a97a69a2', 'cc11aac6-deaa-434d-b9de-4c13cea31da9', '267451fb-7b65-4254-be43-8be2efc39248', 'c216ce5d-b2a2-422e-8c3f-77bab81d739b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:52 devstack sudo[110126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:29:52 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-d89a147b-ac43-4c85-b984-60e560e265b9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c3c96247-8807-415a-9664-0e80b808f0eb req-c6ccd18f-31e3-4a71-9a8b-f07449f21c59 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c3c96247-8807-415a-9664-0e80b808f0eb req-c6ccd18f-31e3-4a71-9a8b-f07449f21c59 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-d89a147b-ac43-4c85-b984-60e560e265b9-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0acba1-97c9-4289-adff-13099fe52d9a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c3c96247-8807-415a-9664-0e80b808f0eb req-c6ccd18f-31e3-4a71-9a8b-f07449f21c59 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-quobyte-d89a147b-ac43-4c85-b984-60e560e265b9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-d89a147b-ac43-4c85-b984-60e560e265b9" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:52 devstack sudo[110128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb3fcb2-bcc3-4711-ac3a-992d4d56cc86]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:52 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:52 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 Jun 24 00:29:52 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:53 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.987s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:53 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:29:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Deleted volume successfully. Jun 24 00:29:53 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cdf3f10c-7fef-4ebf-bec1-53fd0f960f25 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-6adca9ff-f7e6-4a03-a454-8ed52bacb431-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:53 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-c3c96247-8807-415a-9664-0e80b808f0eb req-c6ccd18f-31e3-4a71-9a8b-f07449f21c59 tempest-AttachVolumeNegativeTest-495043411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f" returned: 0 in 1.016s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-c3c96247-8807-415a-9664-0e80b808f0eb req-c6ccd18f-31e3-4a71-9a8b-f07449f21c59 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.056s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-c3c96247-8807-415a-9664-0e80b808f0eb req-c6ccd18f-31e3-4a71-9a8b-f07449f21c59 tempest-AttachVolumeNegativeTest-495043411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60c23445-380e-4e6c-a792-7825a0798ce4', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:29:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-c3c96247-8807-415a-9664-0e80b808f0eb req-c6ccd18f-31e3-4a71-9a8b-f07449f21c59 tempest-AttachVolumeNegativeTest-495043411 None] attachment_update completed successfully. Jun 24 00:29:54 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9" returned: 0 in 1.292s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:54 devstack sudo[110140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9 Jun 24 00:29:54 devstack sudo[110140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:54 devstack sudo[110140]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d89a147b-ac43-4c85-b984-60e560e265b9" returned: 0 in 0.845s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-d89a147b-ac43-4c85-b984-60e560e265b9" released by "delete_volume" :: held 2.206s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Created reservations ['b3773cfd-ab36-44c4-addc-41731744b1de', '0158e4be-383f-48a3-8aa3-87f280edf7b7', '2065690c-4101-4a6e-8d1a-1495d8bcd05e', '712fcd62-fbd5-4c6c-bd15-9ea7cc323ac0'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:55 devstack sudo[110526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:29:55 devstack sudo[110526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Flow 'volume_create_manager' (8cd45c12-e831-4e19-99e6-a9d6c8033f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2833005e-cd6f-44a0-a19d-1aeb5765e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2833005e-cd6f-44a0-a19d-1aeb5765e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1733359769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26477474-7b28-4658-9930-78cf2f43fcdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a83b0f676144eeaa0ced8e907bba16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:56Z,use_quota=True,user_id='d0b1627055704828921be922fe1b5f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5a0599-48f0-46e8-9d23-b82a408e0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5a0599-48f0-46e8-9d23-b82a408e0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc45d6f-4b2c-4da1-81f0-9e0bfd7fe768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc45d6f-4b2c-4da1-81f0-9e0bfd7fe768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26477474-7b28-4658-9930-78cf2f43fcdc', 'volume_name': 'volume-26477474-7b28-4658-9930-78cf2f43fcdc', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81c3b2b-afce-4e1a-b3ca-208ea723c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81c3b2b-afce-4e1a-b3ca-208ea723c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b126944c-a95b-4dba-adab-2e22ecfe3eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Volume 26477474-7b28-4658-9930-78cf2f43fcdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26477474-7b28-4658-9930-78cf2f43fcdc', 'volume_size': 1} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:55 devstack sudo[110526]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1733359769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26477474-7b28-4658-9930-78cf2f43fcdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a83b0f676144eeaa0ced8e907bba16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:56Z,use_quota=True,user_id='d0b1627055704828921be922fe1b5f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Creating volume 26477474-7b28-4658-9930-78cf2f43fcdc {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:55 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.740s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:29:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Deleted volume successfully. Jun 24 00:29:55 devstack sudo[110530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc 1073741824 Jun 24 00:29:55 devstack sudo[110530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c51623-be5f-4524-9cbf-592431e10f72 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-d89a147b-ac43-4c85-b984-60e560e265b9-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-06934192-a0d3-435b-a3e6-fc8ea1912e8b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-06934192-a0d3-435b-a3e6-fc8ea1912e8b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-quobyte-06934192-a0d3-435b-a3e6-fc8ea1912e8b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:55 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-06934192-a0d3-435b-a3e6-fc8ea1912e8b" acquired by "delete_volume" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[daac6968-1752-4651-88df-7a11ccc45a1b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Flow 'volume_create_manager' (e354eeae-1d78-480c-89cd-6ba2c525def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93bd1d9-5381-41e8-bd71-0e41fb5ea10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93bd1d9-5381-41e8-bd71-0e41fb5ea10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1345359113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9ba905-f218-4b6d-8eae-66dec148051e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a83b0f676144eeaa0ced8e907bba16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:56Z,use_quota=True,user_id='d0b1627055704828921be922fe1b5f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f3ea7d-1cef-4960-a9c7-2a4bd021c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f3ea7d-1cef-4960-a9c7-2a4bd021c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86103771-60ef-4ff2-bcff-164d1b63b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86103771-60ef-4ff2-bcff-164d1b63b56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9ba905-f218-4b6d-8eae-66dec148051e', 'volume_name': 'volume-7a9ba905-f218-4b6d-8eae-66dec148051e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d0089a-34a3-4997-87ff-b133b873236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:56 devstack sudo[110533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b Jun 24 00:29:56 devstack sudo[110533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d0089a-34a3-4997-87ff-b133b873236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ede6754-9535-480d-8673-5ae2e5c67cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Volume 7a9ba905-f218-4b6d-8eae-66dec148051e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9ba905-f218-4b6d-8eae-66dec148051e', 'volume_size': 1} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:56 devstack sudo[110530]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc 1073741824" returned: 0 in 1.079s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:56 devstack sudo[110542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc Jun 24 00:29:56 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:56 devstack sudo[110533]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b" returned: 0 in 0.904s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:56 devstack sudo[110544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b Jun 24 00:29:56 devstack sudo[110544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:57 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc" returned: 0 in 0.764s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.433s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1345359113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9ba905-f218-4b6d-8eae-66dec148051e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a83b0f676144eeaa0ced8e907bba16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:29:56Z,use_quota=True,user_id='d0b1627055704828921be922fe1b5f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Creating volume 7a9ba905-f218-4b6d-8eae-66dec148051e {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:29:57 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:57 devstack sudo[110548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e 1073741824 Jun 24 00:29:57 devstack sudo[110548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b126944c-a95b-4dba-adab-2e22ecfe3eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26477474-7b28-4658-9930-78cf2f43fcdc', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1288e92b-5e0a-4da1-8fca-c53bed80477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:57 devstack sudo[110544]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Volume volume-26477474-7b28-4658-9930-78cf2f43fcdc (26477474-7b28-4658-9930-78cf2f43fcdc): created successfully Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1288e92b-5e0a-4da1-8fca-c53bed80477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Flow 'volume_create_manager' (8cd45c12-e831-4e19-99e6-a9d6c8033f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-06934192-a0d3-435b-a3e6-fc8ea1912e8b" returned: 0 in 0.760s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-06934192-a0d3-435b-a3e6-fc8ea1912e8b" released by "delete_volume" :: held 1.729s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-344d5767-d2a6-4443-9e2e-084aef37795a tempest-TestServerVolumeAttachmentScenario-430963502 None] Created volume successfully. Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Created reservations ['29e123c7-6924-412d-a427-4dadd4c2f68f', '0c7d3363-05f5-4bbf-a766-a4cf86b91de7', '1a1691b3-bd3a-4fc4-8dee-ee5e3d95d6d5', 'b27a0b46-a464-4538-97d5-d4e6371f2738'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:57 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:29:57 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-5254b59c-2bcf-485b-93c8-dfaf9c2dce50-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-5254b59c-2bcf-485b-93c8-dfaf9c2dce50-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "cinder-quobyte-5254b59c-2bcf-485b-93c8-dfaf9c2dce50" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-5254b59c-2bcf-485b-93c8-dfaf9c2dce50" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56ba922-01b0-4b7e-b23c-3c31668bf5ab]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:58 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 Jun 24 00:29:58 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:58 devstack sudo[110548]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e 1073741824" returned: 0 in 1.079s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:58 devstack sudo[110558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e Jun 24 00:29:58 devstack sudo[110558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:58 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.972s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:29:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Deleted volume successfully. Jun 24 00:29:58 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5cd79918-7107-40e8-bd13-44f492308513 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-06934192-a0d3-435b-a3e6-fc8ea1912e8b-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:29:59 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50" returned: 0 in 1.039s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:29:59 devstack sudo[110566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50 Jun 24 00:29:59 devstack sudo[110566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:29:59 devstack sudo[110558]: pam_unix(sudo:session): session closed for user root Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e" returned: 0 in 0.809s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ede6754-9535-480d-8673-5ae2e5c67cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9ba905-f218-4b6d-8eae-66dec148051e', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609a56f8-0e88-4807-bf16-b97fae5d7a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:29:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Volume volume-7a9ba905-f218-4b6d-8eae-66dec148051e (7a9ba905-f218-4b6d-8eae-66dec148051e): created successfully Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609a56f8-0e88-4807-bf16-b97fae5d7a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:29:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Flow 'volume_create_manager' (e354eeae-1d78-480c-89cd-6ba2c525def5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:29:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-573a094d-faba-4f8a-a9aa-8db58755a880 tempest-TestServerVolumeAttachmentScenario-430963502 None] Created volume successfully. Jun 24 00:30:00 devstack sudo[110566]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5254b59c-2bcf-485b-93c8-dfaf9c2dce50" returned: 0 in 0.720s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-quobyte-5254b59c-2bcf-485b-93c8-dfaf9c2dce50" released by "delete_volume" :: held 1.812s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Created reservations ['f76e00f4-3a81-4a17-9ba7-a31740a5522a', '71c91f25-d602-45e8-a5a7-0a4c45ea39e3', 'efc5bec8-2ff3-46d9-8ebc-7b14f70ad21b', '73ec0c32-2c4a-4655-9fb6-3d98ff77c06a'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:00 devstack sudo[110573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:00 devstack sudo[110573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-91572327-fcc0-4714-8335-fc12627c5fc3 req-6383077f-7bb4-484c-854b-156f87cbd42c tempest-AttachVolumeNegativeTest-495043411 None] Terminate volume connection completed successfully. Jun 24 00:30:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-91572327-fcc0-4714-8335-fc12627c5fc3 req-6383077f-7bb4-484c-854b-156f87cbd42c tempest-AttachVolumeNegativeTest-495043411 None] Deleting attachment 60c23445-380e-4e6c-a792-7825a0798ce4. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:30:01 devstack sudo[110573]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.727s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:01 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Deleted volume successfully. Jun 24 00:30:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-10546e74-5b8e-469f-8c73-c80f4569bde4 tempest-CreateVolumesFromImageTest-401003865 None] Lock "cinder-5254b59c-2bcf-485b-93c8-dfaf9c2dce50-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (07fa7d19-5cde-4f49-aa34-f1328b2f777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf91eb2-4e38-4535-9a44-95533dd1cc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf91eb2-4e38-4535-9a44-95533dd1cc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132224466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1041d7fa-7492-4346-b06f-37c38e7de982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:04Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed98ede-22c4-4551-9fe3-7f731b99ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed98ede-22c4-4551-9fe3-7f731b99ee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1c631f-c75a-45f5-a789-d02ddde3e404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1c631f-c75a-45f5-a789-d02ddde3e404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1041d7fa-7492-4346-b06f-37c38e7de982', 'volume_name': 'volume-1041d7fa-7492-4346-b06f-37c38e7de982', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9346cc2b-7625-4ade-ab46-d3587e3cb16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9346cc2b-7625-4ade-ab46-d3587e3cb16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1625f8-33c3-41c7-a257-2ce9e0718da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume 1041d7fa-7492-4346-b06f-37c38e7de982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1041d7fa-7492-4346-b06f-37c38e7de982', 'volume_size': 1} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132224466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1041d7fa-7492-4346-b06f-37c38e7de982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:04Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Creating volume 1041d7fa-7492-4346-b06f-37c38e7de982 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:30:03 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:30:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:03 devstack sudo[110631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 1073741824 Jun 24 00:30:03 devstack sudo[110631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:04 devstack sudo[110631]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 1073741824" returned: 0 in 1.057s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:04 devstack sudo[110652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 Jun 24 00:30:04 devstack sudo[110652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:05 devstack sudo[110652]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982" returned: 0 in 0.960s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:30:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1625f8-33c3-41c7-a257-2ce9e0718da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1041d7fa-7492-4346-b06f-37c38e7de982', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296d47b-1825-422d-b0a2-14151123a5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume volume-1041d7fa-7492-4346-b06f-37c38e7de982 (1041d7fa-7492-4346-b06f-37c38e7de982): created successfully Jun 24 00:30:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296d47b-1825-422d-b0a2-14151123a5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (07fa7d19-5cde-4f49-aa34-f1328b2f777f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0345b176-60e4-4d29-90df-b50fc04ef90d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created volume successfully. Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (673a85f1-8838-4895-8c28-1a299c2268e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eeb6665-2f70-4dc6-a344-9604baa9edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eeb6665-2f70-4dc6-a344-9604baa9edf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1863970338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935cad43-1edf-49fa-811e-dc260087edff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:07Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf085e22-69d9-484c-af16-b4e4dd599cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf085e22-69d9-484c-af16-b4e4dd599cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3154f8a4-c72c-4f69-a2db-d898393408ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3154f8a4-c72c-4f69-a2db-d898393408ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '935cad43-1edf-49fa-811e-dc260087edff', 'volume_name': 'volume-935cad43-1edf-49fa-811e-dc260087edff', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959655a6-8ac1-455f-ba3b-6fb39e50ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959655a6-8ac1-455f-ba3b-6fb39e50ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95311d50-89bc-4834-8ee4-777ebf75db1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume 935cad43-1edf-49fa-811e-dc260087edff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-935cad43-1edf-49fa-811e-dc260087edff', 'volume_size': 1} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1863970338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935cad43-1edf-49fa-811e-dc260087edff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:07Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Creating volume 935cad43-1edf-49fa-811e-dc260087edff {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:30:07 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:07 devstack sudo[110680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff 1073741824 Jun 24 00:30:07 devstack sudo[110680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (b620a19c-c4b1-40f9-a2a0-bb8be0cad6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7d8f27-c6af-4e2f-88fd-a3546a73f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7d8f27-c6af-4e2f-88fd-a3546a73f40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-533053014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:08Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cc2638-b2c2-4e3b-a1cd-a9b9749de261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cc2638-b2c2-4e3b-a1cd-a9b9749de261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fb4e8f-4a35-47ca-8c3a-90f97ef44f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fb4e8f-4a35-47ca-8c3a-90f97ef44f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce', 'volume_name': 'volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a56d77d-efb3-43d6-a571-cb53fdc38eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a56d77d-efb3-43d6-a571-cb53fdc38eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a52cb18-356e-40f0-b25d-42d6384a799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:07 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce', 'volume_size': 1} Jun 24 00:30:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (7b1f32b7-6afb-4bad-a28a-dfd99b31a234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161318a-d562-4c80-8c87-8404ebd0ed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161318a-d562-4c80-8c87-8404ebd0ed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-54879639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209fc80b-9d79-4aa4-a230-b91bdc0d7638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:08Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ed39c6-9aae-4810-bd1c-d45f6a7b0220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ed39c6-9aae-4810-bd1c-d45f6a7b0220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657c1725-4f7d-43d2-b03f-504800972951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657c1725-4f7d-43d2-b03f-504800972951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209fc80b-9d79-4aa4-a230-b91bdc0d7638', 'volume_name': 'volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384738a8-3c7c-48b2-9609-a2ead72e7751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384738a8-3c7c-48b2-9609-a2ead72e7751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18873697-5c54-4562-abf9-51bcd185e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume 209fc80b-9d79-4aa4-a230-b91bdc0d7638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638', 'volume_size': 1} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:08 devstack sudo[110680]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff 1073741824" returned: 0 in 1.210s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:08 devstack sudo[110720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff Jun 24 00:30:08 devstack sudo[110720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (ff68fa72-9cab-4dce-b75b-fe4ffd1e752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9cb425-2eb6-483b-9b25-bc6751a68e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9cb425-2eb6-483b-9b25-bc6751a68e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093869537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430065a6-74f2-441f-85be-1132ecb0c840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:09Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3dc225-fe13-44d7-9eaf-0b54e3c925f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3dc225-fe13-44d7-9eaf-0b54e3c925f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdae9ee-551e-463d-a3e5-0ad1ba56434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdae9ee-551e-463d-a3e5-0ad1ba56434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430065a6-74f2-441f-85be-1132ecb0c840', 'volume_name': 'volume-430065a6-74f2-441f-85be-1132ecb0c840', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e860da-1dc0-49dc-bfe3-da4d2b30be01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e860da-1dc0-49dc-bfe3-da4d2b30be01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b136a0-a332-4078-bb14-16d88eef0aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume 430065a6-74f2-441f-85be-1132ecb0c840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430065a6-74f2-441f-85be-1132ecb0c840', 'volume_size': 1} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (b25da027-e66f-4f85-b54a-6dcafdbff5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f596bc-76a1-40ce-a682-59dcaa070973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f596bc-76a1-40ce-a682-59dcaa070973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1980232922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff154ffa-a039-4317-8ff5-6624489a0089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:09Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4c643e-0d8c-40c2-882e-a709f09ffa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4c643e-0d8c-40c2-882e-a709f09ffa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30df908-1615-4807-8db3-de5e59f74103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30df908-1615-4807-8db3-de5e59f74103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff154ffa-a039-4317-8ff5-6624489a0089', 'volume_name': 'volume-ff154ffa-a039-4317-8ff5-6624489a0089', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3073aa-14a4-4acb-81f1-0bbc44b4208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3073aa-14a4-4acb-81f1-0bbc44b4208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bf5b2d-1133-418b-a877-be0ad1016012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume ff154ffa-a039-4317-8ff5-6624489a0089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff154ffa-a039-4317-8ff5-6624489a0089', 'volume_size': 1} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:09 devstack sudo[110720]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff" returned: 0 in 0.822s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-533053014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:08Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Creating volume a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:30:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:09 devstack sudo[110725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce 1073741824 Jun 24 00:30:09 devstack sudo[110725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95311d50-89bc-4834-8ee4-777ebf75db1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935cad43-1edf-49fa-811e-dc260087edff', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c28ff5-6c5b-43ab-87a1-1de2fcdf4a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume volume-935cad43-1edf-49fa-811e-dc260087edff (935cad43-1edf-49fa-811e-dc260087edff): created successfully Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c28ff5-6c5b-43ab-87a1-1de2fcdf4a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (673a85f1-8838-4895-8c28-1a299c2268e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3ccee7e3-441c-4453-bf27-7db0b56f4d9c tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created volume successfully. Jun 24 00:30:10 devstack sudo[110725]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce 1073741824" returned: 0 in 0.996s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:10 devstack sudo[110734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce Jun 24 00:30:10 devstack sudo[110734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:11 devstack sudo[110734]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce" returned: 0 in 0.721s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.733s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-54879639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209fc80b-9d79-4aa4-a230-b91bdc0d7638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:08Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Creating volume 209fc80b-9d79-4aa4-a230-b91bdc0d7638 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:30:11 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a52cb18-356e-40f0-b25d-42d6384a799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:11 devstack sudo[110740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 1073741824 Jun 24 00:30:11 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb513e7-5873-434a-9eaa-1e8565b8bf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce (a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce): created successfully Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb513e7-5873-434a-9eaa-1e8565b8bf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (b620a19c-c4b1-40f9-a2a0-bb8be0cad6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "cinder-0eeafa16-fa36-4efc-8e34-e14f9e5e010f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d3bfc325-22d1-4273-bdef-8f347000ee2d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created volume successfully. Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-0eeafa16-fa36-4efc-8e34-e14f9e5e010f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "cinder-quobyte-0eeafa16-fa36-4efc-8e34-e14f9e5e010f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-quobyte-0eeafa16-fa36-4efc-8e34-e14f9e5e010f" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e686a8b7-b91f-4c75-859d-619ec1283a72]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:11 devstack sudo[110745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f Jun 24 00:30:11 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:12 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 1073741824" returned: 0 in 1.191s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:12 devstack sudo[110813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 Jun 24 00:30:12 devstack sudo[110813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:12 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f" returned: 0 in 1.233s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:12 devstack sudo[110819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f Jun 24 00:30:12 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:13 devstack sudo[110813]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638" returned: 0 in 1.027s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.670s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093869537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430065a6-74f2-441f-85be-1132ecb0c840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:09Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Creating volume 430065a6-74f2-441f-85be-1132ecb0c840 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:30:13 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:13 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0eeafa16-fa36-4efc-8e34-e14f9e5e010f" returned: 0 in 0.919s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:13 devstack sudo[110835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 1073741824 Jun 24 00:30:13 devstack sudo[110835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18873697-5c54-4562-abf9-51bcd185e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76994ead-1cc9-4a89-8aff-56c74e715f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-quobyte-0eeafa16-fa36-4efc-8e34-e14f9e5e010f" released by "delete_volume" :: held 2.214s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 (209fc80b-9d79-4aa4-a230-b91bdc0d7638): created successfully Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76994ead-1cc9-4a89-8aff-56c74e715f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (7b1f32b7-6afb-4bad-a28a-dfd99b31a234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-d8677451-45a3-4706-861a-3fd5da68ad7d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created volume successfully. Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Created reservations ['fab7b1f6-b589-4862-b36b-929bc5346c0b', '857aaba7-49cb-4900-898d-5d7b49e5a721', 'a98e9163-19c8-40e9-9b77-b8e1a92a3758', '33d412d5-37e1-4944-b24b-c466bf6bfd28'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:14 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:14 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:14 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.743s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Deleted volume successfully. Jun 24 00:30:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b609f1d3-2245-4807-9179-475a9c0f8d1d tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-0eeafa16-fa36-4efc-8e34-e14f9e5e010f-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:14 devstack sudo[110835]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 1073741824" returned: 0 in 1.182s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:14 devstack sudo[110845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 Jun 24 00:30:14 devstack sudo[110845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "cinder-839a6a5b-653a-4f60-90e5-d7c42e5fc726-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-839a6a5b-653a-4f60-90e5-d7c42e5fc726-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "cinder-quobyte-839a6a5b-653a-4f60-90e5-d7c42e5fc726" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-quobyte-839a6a5b-653a-4f60-90e5-d7c42e5fc726" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3b392-0ab7-4075-b33f-7a34b4d4c4a1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:15 devstack sudo[110847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 Jun 24 00:30:15 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:15 devstack sudo[110845]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840" returned: 0 in 0.867s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.460s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1980232922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff154ffa-a039-4317-8ff5-6624489a0089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653f1ba2f0ec4301af8a3e2c3f7572cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:09Z,use_quota=True,user_id='538622a3cca14a419c8e54c9182a1519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Creating volume ff154ffa-a039-4317-8ff5-6624489a0089 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:30:15 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b136a0-a332-4078-bb14-16d88eef0aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430065a6-74f2-441f-85be-1132ecb0c840', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1a3c69-98d6-413b-98e5-88dd17b13540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume volume-430065a6-74f2-441f-85be-1132ecb0c840 (430065a6-74f2-441f-85be-1132ecb0c840): created successfully Jun 24 00:30:15 devstack sudo[110850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 1073741824 Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1a3c69-98d6-413b-98e5-88dd17b13540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:15 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (ff68fa72-9cab-4dce-b75b-fe4ffd1e752f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6066c2c1-db22-4467-87f6-bb279e652985 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created volume successfully. Jun 24 00:30:16 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726" returned: 0 in 1.202s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:16 devstack sudo[110856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726 Jun 24 00:30:16 devstack sudo[110856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:17 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 1073741824" returned: 0 in 1.241s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:17 devstack sudo[110865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 Jun 24 00:30:17 devstack sudo[110865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:17 devstack sudo[110856]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-839a6a5b-653a-4f60-90e5-d7c42e5fc726" returned: 0 in 1.003s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-quobyte-839a6a5b-653a-4f60-90e5-d7c42e5fc726" released by "delete_volume" :: held 2.270s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Created reservations ['817e0949-72a1-40da-bc7e-60a598b310d4', 'a90cf98a-861a-445b-b3b4-823b54a97f1f', '2c8b6e29-b9ee-4f1a-815e-0aa5fd3eb1cd', 'a52ee7dc-6046-4252-a2c3-8585b890fc01'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:17 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:17 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:18 devstack sudo[110865]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089" returned: 0 in 0.889s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bf5b2d-1133-418b-a877-be0ad1016012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff154ffa-a039-4317-8ff5-6624489a0089', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac7ebae-274f-4a36-bcec-6ebe1da83f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Volume volume-ff154ffa-a039-4317-8ff5-6624489a0089 (ff154ffa-a039-4317-8ff5-6624489a0089): created successfully Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac7ebae-274f-4a36-bcec-6ebe1da83f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Flow 'volume_create_manager' (b25da027-e66f-4f85-b54a-6dcafdbff5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2817d7db-dca3-4d5f-997c-071a109bd50b tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created volume successfully. Jun 24 00:30:18 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.699s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Deleted volume successfully. Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-577808dd-97bc-4286-a65f-9b85d97c9bbd tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-839a6a5b-653a-4f60-90e5-d7c42e5fc726-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-ff154ffa-a039-4317-8ff5-6624489a0089-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-ff154ffa-a039-4317-8ff5-6624489a0089-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-quobyte-ff154ffa-a039-4317-8ff5-6624489a0089" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-ff154ffa-a039-4317-8ff5-6624489a0089" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e95162-7384-4e6b-8383-3b066d9cfa9a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "cinder-64c9ef33-3d2a-480e-81bb-88a57cb43419-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:18 devstack sudo[110874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 Jun 24 00:30:18 devstack sudo[110874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-64c9ef33-3d2a-480e-81bb-88a57cb43419-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "cinder-quobyte-64c9ef33-3d2a-480e-81bb-88a57cb43419" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-quobyte-64c9ef33-3d2a-480e-81bb-88a57cb43419" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c81dcf1-be51-466c-ac1c-837709f991e7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:18 devstack sudo[110876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 Jun 24 00:30:18 devstack sudo[110876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:19 devstack sudo[110874]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089" returned: 0 in 0.934s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:19 devstack sudo[110885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089 Jun 24 00:30:19 devstack sudo[110885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:19 devstack sudo[110876]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419" returned: 0 in 0.782s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:19 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419 Jun 24 00:30:19 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:20 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-64c9ef33-3d2a-480e-81bb-88a57cb43419" returned: 0 in 0.613s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-quobyte-64c9ef33-3d2a-480e-81bb-88a57cb43419" released by "delete_volume" :: held 1.439s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:20 devstack sudo[110885]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ff154ffa-a039-4317-8ff5-6624489a0089" returned: 0 in 0.746s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-ff154ffa-a039-4317-8ff5-6624489a0089" released by "delete_volume" :: held 1.724s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Created reservations ['ec1e7d00-c511-482e-bc14-f6b668c3fc4f', 'f1a559e9-7142-4e8c-ad9d-e8615ed1a49a', 'e04202ae-f0df-431c-9643-8b409b9f7673', '3c2bc298-2a63-4c8d-9c22-028b98b497bd'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created reservations ['0b65cbbf-76b7-4851-9da7-822f14024354', '5933b227-fd41-4a77-b45f-a77891db3cfa', '4f986a1f-d944-4be1-abef-0892fa24df13', 'd2e33292-8b8a-4f70-a3f7-49bf63175e0c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:20 devstack sudo[110892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:20 devstack sudo[110892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:20 devstack sudo[110894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:20 devstack sudo[110894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-430065a6-74f2-441f-85be-1132ecb0c840-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-430065a6-74f2-441f-85be-1132ecb0c840-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-quobyte-430065a6-74f2-441f-85be-1132ecb0c840" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-430065a6-74f2-441f-85be-1132ecb0c840" acquired by "delete_volume" :: waited 0.035s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb97ef0-8c45-4f58-a25e-91b3f40ea3fb]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:21 devstack sudo[110896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 Jun 24 00:30:21 devstack sudo[110896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:21 devstack sudo[110892]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.908s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:21 devstack sudo[110894]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Deleted volume successfully. Jun 24 00:30:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.887s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Deleted volume successfully. Jun 24 00:30:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-21ccf132-4b41-4528-9a4b-df7a70044d40 tempest-AttachVolumeNegativeTest-495043411 None] Lock "cinder-64c9ef33-3d2a-480e-81bb-88a57cb43419-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-8a59dca6-225c-4dcc-b83e-1f41d9d1bb80 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-ff154ffa-a039-4317-8ff5-6624489a0089-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:21 devstack sudo[110896]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840" returned: 0 in 1.008s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:21 devstack sudo[110903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840 Jun 24 00:30:21 devstack sudo[110903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:22 devstack sudo[110903]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-430065a6-74f2-441f-85be-1132ecb0c840" returned: 0 in 0.709s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-430065a6-74f2-441f-85be-1132ecb0c840" released by "delete_volume" :: held 1.793s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created reservations ['5bf1b0b8-af20-49cb-aa21-cf4a9710a2e7', '39e71653-a074-4f4f-9ce2-09aadd172639', 'd4a5b56f-9ee7-4d94-bb71-d84cd356564c', '33d60451-6911-4782-b6c3-4143c2a9df86'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:22 devstack sudo[110906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:22 devstack sudo[110906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-209fc80b-9d79-4aa4-a230-b91bdc0d7638-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-209fc80b-9d79-4aa4-a230-b91bdc0d7638-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-quobyte-209fc80b-9d79-4aa4-a230-b91bdc0d7638" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-209fc80b-9d79-4aa4-a230-b91bdc0d7638" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c461e6f2-7029-4d64-9802-e71b4bfb0f65]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:23 devstack sudo[110909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 Jun 24 00:30:23 devstack sudo[110909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:23 devstack sudo[110906]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.893s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Deleted volume successfully. Jun 24 00:30:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a16fca21-5c36-4a1e-ba5d-b14bd68ba97d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-430065a6-74f2-441f-85be-1132ecb0c840-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:24 devstack sudo[110909]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638" returned: 0 in 0.871s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:24 devstack sudo[110915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638 Jun 24 00:30:24 devstack sudo[110915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:24 devstack sudo[110915]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-209fc80b-9d79-4aa4-a230-b91bdc0d7638" returned: 0 in 0.755s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-209fc80b-9d79-4aa4-a230-b91bdc0d7638" released by "delete_volume" :: held 1.677s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:24 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created reservations ['17d5f423-e4e5-4ff4-b9db-7f075b534357', '00342093-d110-42f5-b3c6-9def703824b2', '41c8e07d-ffdd-45ad-a4e6-5c47aa08b0d9', 'ece5666c-ce38-4d7b-af1b-14f96fa4b2e3'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:25 devstack sudo[110918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:25 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-quobyte-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e163c30d-47e6-4cfe-b82a-0117226b1f65]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:25 devstack sudo[110923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce Jun 24 00:30:25 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:26 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.014s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:26 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Deleted volume successfully. Jun 24 00:30:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1c5f5d5-ed57-409c-a355-7bd68ab12c16 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-209fc80b-9d79-4aa4-a230-b91bdc0d7638-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:26 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce" returned: 0 in 0.953s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:26 devstack sudo[110946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce Jun 24 00:30:26 devstack sudo[110946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:27 devstack sudo[110946]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce" returned: 0 in 0.655s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce" released by "delete_volume" :: held 1.665s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created reservations ['02bb2125-d689-4bb5-b8d9-9c362ef3d76c', '8efeb964-94ec-42a7-9597-c811e6567465', 'b16edca9-392e-4dd6-92fc-7659723934ae', '01b12dae-7275-47e7-a94b-e611a3a8ce55'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:27 devstack sudo[110949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:27 devstack sudo[110949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-935cad43-1edf-49fa-811e-dc260087edff-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-935cad43-1edf-49fa-811e-dc260087edff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-quobyte-935cad43-1edf-49fa-811e-dc260087edff" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-935cad43-1edf-49fa-811e-dc260087edff" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[05acdf77-8807-48d8-8a24-f10cf1d61667]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:28 devstack sudo[110951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff Jun 24 00:30:28 devstack sudo[110951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:28 devstack sudo[110949]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.689s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:28 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Deleted volume successfully. Jun 24 00:30:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-87ac96be-d9e8-495a-bc83-0b95a5cd3f1d tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-a0c8fd32-37b9-4924-ad79-ab4ddc4cd9ce-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:28 devstack sudo[110951]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff" returned: 0 in 0.781s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:28 devstack sudo[110957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff Jun 24 00:30:28 devstack sudo[110957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Flow 'volume_create_manager' (3b390307-b9c9-4469-8700-7a83ca0a27ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11052e6c-b2a6-400e-8e5f-d61f6e70677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11052e6c-b2a6-400e-8e5f-d61f6e70677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-907549471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6330ac-bc79-4dd4-bb41-39aeb80724da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05346e1643624d129849365446c42c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:29Z,use_quota=True,user_id='682aa7b0b1274df2a7de2058faeef61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845f4a87-566c-47ca-bfb4-f6c555b37c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845f4a87-566c-47ca-bfb4-f6c555b37c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b4fbf0-c0b0-4aff-ad03-1f1ba1b0bc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b4fbf0-c0b0-4aff-ad03-1f1ba1b0bc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6330ac-bc79-4dd4-bb41-39aeb80724da', 'volume_name': 'volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5631323d-9a2e-4aec-b1cd-0bcbd3e49cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5631323d-9a2e-4aec-b1cd-0bcbd3e49cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc27f0a-0c5d-47e6-bc74-7818d192719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Volume 9d6330ac-bc79-4dd4-bb41-39aeb80724da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da', 'volume_size': 1} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-907549471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6330ac-bc79-4dd4-bb41-39aeb80724da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05346e1643624d129849365446c42c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:30:29Z,use_quota=True,user_id='682aa7b0b1274df2a7de2058faeef61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Creating volume 9d6330ac-bc79-4dd4-bb41-39aeb80724da {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:30:29 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:29 devstack sudo[110959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da 1073741824 Jun 24 00:30:29 devstack sudo[110959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:29 devstack sudo[110957]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-935cad43-1edf-49fa-811e-dc260087edff" returned: 0 in 0.646s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-935cad43-1edf-49fa-811e-dc260087edff" released by "delete_volume" :: held 1.481s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created reservations ['f5a693b6-f6cf-47b2-9e03-b9259983b102', '24d497c8-4f52-446d-a04d-a9e04428e9e3', '08743401-1939-4c98-a44b-8bfe5082cd9f', '6186157e-6c83-46d0-a36e-9f6a783120fa'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:29 devstack sudo[110962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:29 devstack sudo[110962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:30 devstack sudo[110959]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da 1073741824" returned: 0 in 0.908s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-1041d7fa-7492-4346-b06f-37c38e7de982-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:30 devstack sudo[110967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da Jun 24 00:30:30 devstack sudo[110967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-1041d7fa-7492-4346-b06f-37c38e7de982-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "cinder-quobyte-1041d7fa-7492-4346-b06f-37c38e7de982" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-1041d7fa-7492-4346-b06f-37c38e7de982" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38da5c5-44c4-4d3b-b4ae-c5de8b080e9c]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:30 devstack sudo[110962]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.723s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Deleted volume successfully. Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bad44546-5360-4f83-bba9-730137b39693 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-935cad43-1edf-49fa-811e-dc260087edff-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:30 devstack sudo[110970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 Jun 24 00:30:30 devstack sudo[110970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:30 devstack sudo[110967]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da" returned: 0 in 0.679s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc27f0a-0c5d-47e6-bc74-7818d192719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c061cd1-9bea-4a68-baad-7feb1a4a67a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:30:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Volume volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da (9d6330ac-bc79-4dd4-bb41-39aeb80724da): created successfully Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c061cd1-9bea-4a68-baad-7feb1a4a67a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Flow 'volume_create_manager' (3b390307-b9c9-4469-8700-7a83ca0a27ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:30:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-bffd51d5-eb81-4f8d-85d2-5808d8ec68e6 req-d679777f-a27c-4c95-99e5-4a3014db7f75 tempest-VolumesSnapshotsTestJSON-869989864 None] Created volume successfully. Jun 24 00:30:30 devstack sudo[110970]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982" returned: 0 in 0.743s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:30 devstack sudo[110976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982 Jun 24 00:30:30 devstack sudo[110976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Creating offline snapshot 5c6b13a9-9c0e-45d6-8c42-b856c054f9ed of volume 9d6330ac-bc79-4dd4-bb41-39aeb80724da {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da5363e-3949-479c-8a1e-fa118f3fccdc]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:31 devstack sudo[110976]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1041d7fa-7492-4346-b06f-37c38e7de982" returned: 0 in 0.679s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-quobyte-1041d7fa-7492-4346-b06f-37c38e7de982" released by "delete_volume" :: held 1.477s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:31 devstack sudo[110978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da Jun 24 00:30:31 devstack sudo[110978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Created reservations ['2ef9b61f-eed5-4fd4-a2b4-ceb9138f17eb', '202359ad-c002-450f-8e93-568da018cdd1', '82ab2261-5738-45cd-bd53-d0f351f84220', '2aa5a02b-0048-4918-bf20-dfa54d144570'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:31 devstack sudo[110981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:31 devstack sudo[110981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:32 devstack sudo[110978]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da" returned: 0 in 0.930s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:32 devstack sudo[110987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed 1G Jun 24 00:30:32 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:32 devstack sudo[110981]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.916s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:32 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Deleted volume successfully. Jun 24 00:30:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c23576bc-e809-4d68-ae19-8f9f327585a2 tempest-CreateVolumesFromSourceVolumeTest-1242840618 None] Lock "cinder-1041d7fa-7492-4346-b06f-37c38e7de982-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:33 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed 1G" returned: 0 in 1.034s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:33 devstack sudo[110994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed Jun 24 00:30:33 devstack sudo[110994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:34 devstack sudo[110994]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed" returned: 0 in 0.788s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:34 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed is being set with open permissions: ugo+rw Jun 24 00:30:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:34 devstack sudo[111000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed Jun 24 00:30:34 devstack sudo[111000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:34 devstack sudo[111000]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed" returned: 0 in 0.737s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:35 devstack sudo[111003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.info Jun 24 00:30:35 devstack sudo[111003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:35 devstack sudo[111003]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.info" returned: 0 in 0.680s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:35 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.info is being set with open permissions: ugo+rw Jun 24 00:30:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:35 devstack sudo[111006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.info Jun 24 00:30:35 devstack sudo[111006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:36 devstack sudo[111006]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.info" returned: 0 in 0.668s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.964s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-3838e380-5887-4cd6-a9de-7731ef0a9612 req-bc3b11ec-5f30-493f-ae8d-84afc367449c tempest-VolumesSnapshotsTestJSON-869989864 None] Create snapshot completed successfully Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "cinder-5c6b13a9-9c0e-45d6-8c42-b856c054f9ed-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-5c6b13a9-9c0e-45d6-8c42-b856c054f9ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "cinder-quobyte-9d6330ac-bc79-4dd4-bb41-39aeb80724da" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-quobyte-9d6330ac-bc79-4dd4-bb41-39aeb80724da" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "cinder-quobyte-5c6b13a9-9c0e-45d6-8c42-b856c054f9ed" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-quobyte-5c6b13a9-9c0e-45d6-8c42-b856c054f9ed" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Deleting offline snapshot 5c6b13a9-9c0e-45d6-8c42-b856c054f9ed of volume 9d6330ac-bc79-4dd4-bb41-39aeb80724da {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] snapshot_file for this snap is: volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2604c9-81bb-47a8-96da-0cb48eb37a43]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:37 devstack sudo[111012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed Jun 24 00:30:37 devstack sudo[111012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:38 devstack sudo[111012]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed" returned: 0 in 0.990s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:38 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:30:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fd7d22-9593-4feb-8c99-f3ff56b61108]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:38 devstack sudo[111020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da Jun 24 00:30:38 devstack sudo[111020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:39 devstack sudo[111020]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da" returned: 0 in 0.861s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:39 devstack sudo[111025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed Jun 24 00:30:39 devstack sudo[111025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:39 devstack sudo[111030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:39 devstack sudo[111030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:39 devstack sudo[111025]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed" returned: 0 in 0.815s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:40 devstack sudo[111033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed Jun 24 00:30:40 devstack sudo[111033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:40 devstack sudo[111030]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.046s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:30:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:30:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:30:41 devstack sudo[111033]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da.5c6b13a9-9c0e-45d6-8c42-b856c054f9ed" returned: 0 in 1.071s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=160,cinder:SELECT=104,cinder:INSERT=43,cinder:DELETE=9 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=114,cinder:UPDATE=160,cinder:DELETE=21,cinder:INSERT=29 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-quobyte-5c6b13a9-9c0e-45d6-8c42-b856c054f9ed" released by "_delete_snapshot" :: held 3.910s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-quobyte-9d6330ac-bc79-4dd4-bb41-39aeb80724da" released by "delete_snapshot" :: held 3.946s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG cinder.quota [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Created reservations ['f9e41465-e4cc-4f2f-8987-9e32e4e69822', 'af3d4220-6bd4-473a-a7a5-d72de42d9633', 'f8c998c3-bc83-4e2c-85f1-916225b1408b', '668f80a5-c752-45e2-84fe-5620c343e069'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Delete snapshot completed successfully. Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-a488ecc2-6123-4936-9c4b-8b1161736a20 req-6a1c6e19-a3a2-44b6-b117-b5d76397fea4 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-5c6b13a9-9c0e-45d6-8c42-b856c054f9ed-delete_snapshot" released by "delete_snapshot" :: held 4.174s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f33670a0-15b2-47c5-ae76-c4027bb4ac49 req-98dc0adc-4e75-40a4-948c-0a6bb94fdd2a tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f33670a0-15b2-47c5-ae76-c4027bb4ac49 req-98dc0adc-4e75-40a4-948c-0a6bb94fdd2a tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b79b5c-bdc1-4baf-9fa3-4924217fc096]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f33670a0-15b2-47c5-ae76-c4027bb4ac49 req-98dc0adc-4e75-40a4-948c-0a6bb94fdd2a tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:41 devstack sudo[111045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc Jun 24 00:30:41 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "cinder-9d6330ac-bc79-4dd4-bb41-39aeb80724da-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-9d6330ac-bc79-4dd4-bb41-39aeb80724da-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "cinder-quobyte-9d6330ac-bc79-4dd4-bb41-39aeb80724da" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-quobyte-9d6330ac-bc79-4dd4-bb41-39aeb80724da" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[228c191f-93ae-4b02-9a71-7664e0785a83]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:42 devstack sudo[111047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da Jun 24 00:30:42 devstack sudo[111047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:42 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-f33670a0-15b2-47c5-ae76-c4027bb4ac49 req-98dc0adc-4e75-40a4-948c-0a6bb94fdd2a tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc" returned: 0 in 1.201s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-f33670a0-15b2-47c5-ae76-c4027bb4ac49 req-98dc0adc-4e75-40a4-948c-0a6bb94fdd2a tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.226s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-f33670a0-15b2-47c5-ae76-c4027bb4ac49 req-98dc0adc-4e75-40a4-948c-0a6bb94fdd2a tempest-TestServerVolumeAttachmentScenario-430963502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-26477474-7b28-4658-9930-78cf2f43fcdc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5be71606-a030-48e4-82c3-d51e3d2f012e', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:30:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-f33670a0-15b2-47c5-ae76-c4027bb4ac49 req-98dc0adc-4e75-40a4-948c-0a6bb94fdd2a tempest-TestServerVolumeAttachmentScenario-430963502 None] attachment_update completed successfully. Jun 24 00:30:43 devstack sudo[111047]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da" returned: 0 in 1.190s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:43 devstack sudo[111084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da Jun 24 00:30:43 devstack sudo[111084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:43 devstack sudo[111084]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9d6330ac-bc79-4dd4-bb41-39aeb80724da" returned: 0 in 0.910s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-quobyte-9d6330ac-bc79-4dd4-bb41-39aeb80724da" released by "delete_volume" :: held 2.204s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG cinder.quota [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Created reservations ['189160df-6cc9-498f-a782-35a7b67cde48', '1b0470c3-f38c-4696-8f30-8638394660b5', '3479e134-698f-42a0-8498-ffad19a236a1', '0486075b-77ee-457b-a7cf-ba188743c83f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:44 devstack sudo[111450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:30:44 devstack sudo[111450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:44 devstack sudo[111450]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.722s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG cinder.manager [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:30:44 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Deleted volume successfully. Jun 24 00:30:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [req-6f25a4c4-d236-4931-a529-3a991a9f2426 req-bd20d223-78b6-4945-ae9e-2fb7912d0da8 tempest-VolumesSnapshotsTestJSON-869989864 None] Lock "cinder-9d6330ac-bc79-4dd4-bb41-39aeb80724da-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:30:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-87e10221-8e11-4816-a792-16530f77de2d req-430beff4-1c67-411b-bd5b-955f6fc3878a tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:30:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-87e10221-8e11-4816-a792-16530f77de2d req-430beff4-1c67-411b-bd5b-955f6fc3878a tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:30:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8274aaee-02a9-42a0-a829-9b8491fb8eeb]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:30:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-87e10221-8e11-4816-a792-16530f77de2d req-430beff4-1c67-411b-bd5b-955f6fc3878a tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:30:54 devstack sudo[111465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e Jun 24 00:30:54 devstack sudo[111465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:30:54 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:30:55 devstack sudo[111465]: pam_unix(sudo:session): session closed for user root Jun 24 00:30:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-87e10221-8e11-4816-a792-16530f77de2d req-430beff4-1c67-411b-bd5b-955f6fc3878a tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e" returned: 0 in 0.891s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:30:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-87e10221-8e11-4816-a792-16530f77de2d req-430beff4-1c67-411b-bd5b-955f6fc3878a tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:30:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-87e10221-8e11-4816-a792-16530f77de2d req-430beff4-1c67-411b-bd5b-955f6fc3878a tempest-TestServerVolumeAttachmentScenario-430963502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-7a9ba905-f218-4b6d-8eae-66dec148051e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b1ddcbc-0d1b-43af-8b1a-a876723105e1', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:30:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-87e10221-8e11-4816-a792-16530f77de2d req-430beff4-1c67-411b-bd5b-955f6fc3878a tempest-TestServerVolumeAttachmentScenario-430963502 None] attachment_update completed successfully. Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Flow 'volume_create_manager' (c4820e88-f0c6-4bba-aded-2588c1d1d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99a631d-f1c6-483f-a320-cc63512880f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99a631d-f1c6-483f-a320-cc63512880f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1977626132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f08229-28fc-459b-8511-9178a5fc8deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12b83780c0741c797f4e0ff87de9bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:31:00Z,use_quota=True,user_id='6f7f175dd400471ab4a2ed0b10a45d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501bd7e6-eea4-4558-82ef-7f1963709dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501bd7e6-eea4-4558-82ef-7f1963709dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1f7dfb-7784-4627-8537-7b5d6a36c7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1f7dfb-7784-4627-8537-7b5d6a36c7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f08229-28fc-459b-8511-9178a5fc8deb', 'volume_name': 'volume-00f08229-28fc-459b-8511-9178a5fc8deb', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053e117b-9e02-43c2-ab67-0bbbd2f64d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053e117b-9e02-43c2-ab67-0bbbd2f64d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a219c5-42e6-4091-8231-346db4a1c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:00 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Volume 00f08229-28fc-459b-8511-9178a5fc8deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f08229-28fc-459b-8511-9178a5fc8deb', 'volume_size': 1} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1977626132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f08229-28fc-459b-8511-9178a5fc8deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12b83780c0741c797f4e0ff87de9bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:31:00Z,use_quota=True,user_id='6f7f175dd400471ab4a2ed0b10a45d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Creating volume 00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:31:00 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:31:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:00 devstack sudo[111476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb 1073741824 Jun 24 00:31:00 devstack sudo[111476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:01 devstack sudo[111476]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb 1073741824" returned: 0 in 0.897s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:01 devstack sudo[111482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb Jun 24 00:31:01 devstack sudo[111482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-53efecd1-7868-482a-abbc-c889732a9edb req-e2a14103-2c0f-4472-a8fc-6a728e38d4eb tempest-TestServerVolumeAttachmentScenario-430963502 None] Terminate volume connection completed successfully. Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-53efecd1-7868-482a-abbc-c889732a9edb req-e2a14103-2c0f-4472-a8fc-6a728e38d4eb tempest-TestServerVolumeAttachmentScenario-430963502 None] Deleting attachment 6b1ddcbc-0d1b-43af-8b1a-a876723105e1. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:31:02 devstack sudo[111482]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb" returned: 0 in 0.842s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a219c5-42e6-4091-8231-346db4a1c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f08229-28fc-459b-8511-9178a5fc8deb', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf77f64-db73-409c-9eb6-68e6cbe3d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:02 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Volume volume-00f08229-28fc-459b-8511-9178a5fc8deb (00f08229-28fc-459b-8511-9178a5fc8deb): created successfully Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf77f64-db73-409c-9eb6-68e6cbe3d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Flow 'volume_create_manager' (c4820e88-f0c6-4bba-aded-2588c1d1d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:31:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1da43b56-098c-4e9d-b423-9c044e619c0e tempest-SnapshotDependencyTests-182400867 None] Created volume successfully. Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Creating offline snapshot 4d874ae1-d9c3-4990-9bd3-e8b99afa481a of volume 00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895b604-ae98-40cb-9c37-e0fdfe485584]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:02 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb Jun 24 00:31:02 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:03 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb" returned: 0 in 0.925s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:03 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a 1G Jun 24 00:31:03 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:04 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a 1G" returned: 0 in 1.055s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f08229-28fc-459b-8511-9178a5fc8deb -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:04 devstack sudo[111525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f08229-28fc-459b-8511-9178a5fc8deb -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a Jun 24 00:31:04 devstack sudo[111525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:05 devstack sudo[111525]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f08229-28fc-459b-8511-9178a5fc8deb -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a" returned: 0 in 0.879s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:05 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a is being set with open permissions: ugo+rw Jun 24 00:31:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:05 devstack sudo[111534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a Jun 24 00:31:05 devstack sudo[111534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-1116d724-6b5b-4e9f-a094-674eb110ff96 req-59ba09a7-2de2-40d0-8739-07fcf48f4ca2 tempest-TestServerVolumeAttachmentScenario-430963502 None] Terminate volume connection completed successfully. Jun 24 00:31:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-1116d724-6b5b-4e9f-a094-674eb110ff96 req-59ba09a7-2de2-40d0-8739-07fcf48f4ca2 tempest-TestServerVolumeAttachmentScenario-430963502 None] Deleting attachment 5be71606-a030-48e4-82c3-d51e3d2f012e. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:31:06 devstack sudo[111534]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a" returned: 0 in 0.730s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:06 devstack sudo[111541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.info Jun 24 00:31:06 devstack sudo[111541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:07 devstack sudo[111541]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.info" returned: 0 in 0.750s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:07 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.info is being set with open permissions: ugo+rw Jun 24 00:31:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:07 devstack sudo[111545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.info Jun 24 00:31:07 devstack sudo[111545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:07 devstack sudo[111545]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.info" returned: 0 in 0.667s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.132s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-19434ffd-6089-4885-83bd-2e3a23fc4c43 tempest-SnapshotDependencyTests-182400867 None] Create snapshot completed successfully Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Flow 'volume_create_manager' (5cef0333-53e4-4ac9-86b8-4ecdd0e4ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d92654-bf24-46ca-8805-a1715b3b044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d92654-bf24-46ca-8805-a1715b3b044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39830dd5-7f05-41cc-a1ad-a8de2100dbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12b83780c0741c797f4e0ff87de9bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4d874ae1-d9c3-4990-9bd3-e8b99afa481a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:31:09Z,use_quota=True,user_id='6f7f175dd400471ab4a2ed0b10a45d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd00ba7-f35b-4cde-8249-2c66ccae7f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd00ba7-f35b-4cde-8249-2c66ccae7f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1271e7f-c19e-487b-9a22-3564969184ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1271e7f-c19e-487b-9a22-3564969184ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39830dd5-7f05-41cc-a1ad-a8de2100dbf9', 'volume_name': 'volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9', 'volume_size': 1, 'snapshot_id': '4d874ae1-d9c3-4990-9bd3-e8b99afa481a'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19193970-4ef0-40f5-9bf1-21e8a593cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19193970-4ef0-40f5-9bf1-21e8a593cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f1ed0a-da89-4e5b-8449-68b59960454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Volume 39830dd5-7f05-41cc-a1ad-a8de2100dbf9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9', 'volume_size': 1, 'snapshot_id': '4d874ae1-d9c3-4990-9bd3-e8b99afa481a'} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-quobyte-4d874ae1-d9c3-4990-9bd3-e8b99afa481a-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-4d874ae1-d9c3-4990-9bd3-e8b99afa481a-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Creating volume 39830dd5-7f05-41cc-a1ad-a8de2100dbf9 from snapshot 4d874ae1-d9c3-4990-9bd3-e8b99afa481a {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:31:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-quobyte-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] snapshot: 4d874ae1-d9c3-4990-9bd3-e8b99afa481a, volume: 39830dd5-7f05-41cc-a1ad-a8de2100dbf9, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a81335-7265-427b-9966-830a8b2600cc]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:09 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a Jun 24 00:31:09 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:10 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a" returned: 0 in 1.364s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00f08229-28fc-459b-8511-9178a5fc8deb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:31:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:31:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:31:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[186406c1-6b05-40d8-887f-d0dfb3e10bf5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:10 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb Jun 24 00:31:10 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:11 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb" returned: 0 in 0.837s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:11 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:31:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:11 devstack sudo[111645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 Jun 24 00:31:11 devstack sudo[111645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:17 devstack sudo[111645]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" returned: 0 in 6.066s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe883940-79d9-4e6c-a3a3-e0288989d9f7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:17 devstack sudo[111662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb Jun 24 00:31:17 devstack sudo[111662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "cinder-7a9ba905-f218-4b6d-8eae-66dec148051e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "cinder-7a9ba905-f218-4b6d-8eae-66dec148051e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "cinder-quobyte-7a9ba905-f218-4b6d-8eae-66dec148051e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "cinder-quobyte-7a9ba905-f218-4b6d-8eae-66dec148051e" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4f64fb-153d-47dc-81e9-7178f2c67453]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:18 devstack sudo[111666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e Jun 24 00:31:18 devstack sudo[111666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:18 devstack sudo[111662]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb" returned: 0 in 1.085s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:18 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:31:18 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Converted 1024.00 MB image at 168.77 MB/s Jun 24 00:31:18 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 is being set with open permissions: ugo+rw Jun 24 00:31:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:18 devstack sudo[111671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 Jun 24 00:31:18 devstack sudo[111671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:18 devstack sudo[111666]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e" returned: 0 in 0.859s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:18 devstack sudo[111676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e Jun 24 00:31:18 devstack sudo[111676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:19 devstack sudo[111671]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" returned: 0 in 0.719s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" released by "_copy_volume_from_snapshot" :: held 10.182s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-4d874ae1-d9c3-4990-9bd3-e8b99afa481a-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" released by "_create_volume_from_snapshot" :: held 10.215s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.233s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f1ed0a-da89-4e5b-8449-68b59960454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9', 'volume_size': 1, 'snapshot_id': '4d874ae1-d9c3-4990-9bd3-e8b99afa481a'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3713a2-11b3-40a3-b3b5-10186a31dd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Volume volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 (39830dd5-7f05-41cc-a1ad-a8de2100dbf9): created successfully Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3713a2-11b3-40a3-b3b5-10186a31dd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Flow 'volume_create_manager' (5cef0333-53e4-4ac9-86b8-4ecdd0e4ca95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:31:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fa531d1d-5030-4e90-b968-4d0a761acc98 tempest-SnapshotDependencyTests-182400867 None] Created volume successfully. Jun 24 00:31:19 devstack sudo[111676]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7a9ba905-f218-4b6d-8eae-66dec148051e" returned: 0 in 0.764s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "cinder-quobyte-7a9ba905-f218-4b6d-8eae-66dec148051e" released by "delete_volume" :: held 1.673s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Created reservations ['0dfd4c1a-1c06-4eeb-9ece-6a000b661381', 'c5ecdb3f-7ad1-488a-b81d-9287ae2a8c1e', '46b04db0-114c-4b30-8f44-6c7be9c925f5', 'b1fd7171-bb35-4b84-ae66-d5315142d2ed'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:19 devstack sudo[111680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:31:19 devstack sudo[111680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-4d874ae1-d9c3-4990-9bd3-e8b99afa481a-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-4d874ae1-d9c3-4990-9bd3-e8b99afa481a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-quobyte-00f08229-28fc-459b-8511-9178a5fc8deb" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-00f08229-28fc-459b-8511-9178a5fc8deb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-quobyte-4d874ae1-d9c3-4990-9bd3-e8b99afa481a" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-4d874ae1-d9c3-4990-9bd3-e8b99afa481a" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Deleting offline snapshot 4d874ae1-d9c3-4990-9bd3-e8b99afa481a of volume 00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] snapshot_file for this snap is: volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "cinder-26477474-7b28-4658-9930-78cf2f43fcdc-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f292083-b355-4295-9e1b-c7901bf03315]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "cinder-26477474-7b28-4658-9930-78cf2f43fcdc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "cinder-quobyte-26477474-7b28-4658-9930-78cf2f43fcdc" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "cinder-quobyte-26477474-7b28-4658-9930-78cf2f43fcdc" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[52736342-fbd6-4aa1-8636-8240e15aac20]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:20 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a Jun 24 00:31:20 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:20 devstack sudo[111684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc Jun 24 00:31:20 devstack sudo[111684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:20 devstack sudo[111680]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.802s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:31:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Deleted volume successfully. Jun 24 00:31:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-aaafc2a2-3ae2-4d36-80db-c67d2dd8df5d tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "cinder-7a9ba905-f218-4b6d-8eae-66dec148051e-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:21 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a" returned: 0 in 1.142s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00f08229-28fc-459b-8511-9178a5fc8deb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:31:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78b5d65-57f6-44e6-a783-be87565b4291]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:21 devstack sudo[111684]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc" returned: 0 in 1.170s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:21 devstack sudo[111694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb Jun 24 00:31:21 devstack sudo[111695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc Jun 24 00:31:21 devstack sudo[111694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:21 devstack sudo[111695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:22 devstack sudo[111695]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-26477474-7b28-4658-9930-78cf2f43fcdc" returned: 0 in 0.731s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "cinder-quobyte-26477474-7b28-4658-9930-78cf2f43fcdc" released by "delete_volume" :: held 1.941s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:22 devstack sudo[111694]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb" returned: 0 in 0.887s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:22 devstack sudo[111702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a Jun 24 00:31:22 devstack sudo[111702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Created reservations ['70d2df71-9cf3-409a-949c-2c49389a6b5f', 'c0eb1820-5c62-4ba4-811f-c65fce79229a', 'e9738821-630c-4527-aeae-5d59e68edb7c', '646d2ec1-49bb-4b59-bee4-7dc5476c557d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:22 devstack sudo[111704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:31:22 devstack sudo[111704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:23 devstack sudo[111702]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a" returned: 0 in 0.931s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:23 devstack sudo[111711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a Jun 24 00:31:23 devstack sudo[111711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:23 devstack sudo[111704]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.845s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:31:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Deleted volume successfully. Jun 24 00:31:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f38900e6-6a8d-4796-80a5-c8aac44a69e9 tempest-TestServerVolumeAttachmentScenario-430963502 None] Lock "cinder-26477474-7b28-4658-9930-78cf2f43fcdc-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:24 devstack sudo[111711]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb.4d874ae1-d9c3-4990-9bd3-e8b99afa481a" returned: 0 in 0.859s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-4d874ae1-d9c3-4990-9bd3-e8b99afa481a" released by "_delete_snapshot" :: held 4.000s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-00f08229-28fc-459b-8511-9178a5fc8deb" released by "delete_snapshot" :: held 4.045s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:24 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Created reservations ['0213e60d-b649-427e-a27a-fd6c47d89c4b', '9544cded-80b4-4c73-85a1-a0b4ef8c9375', '9c63f204-f4eb-4640-85d3-ead74221bd77', '47e1a6b4-f053-4406-9711-5cade10316ca'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:31:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Delete snapshot completed successfully. Jun 24 00:31:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67e4161a-d8a9-474a-a592-fdb9122b11bb tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-4d874ae1-d9c3-4990-9bd3-e8b99afa481a-delete_snapshot" released by "delete_snapshot" :: held 4.260s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-00f08229-28fc-459b-8511-9178a5fc8deb-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-00f08229-28fc-459b-8511-9178a5fc8deb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-quobyte-00f08229-28fc-459b-8511-9178a5fc8deb" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-00f08229-28fc-459b-8511-9178a5fc8deb" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[52edcc7d-9613-4f2d-ae23-178c03d0a03f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:25 devstack sudo[111715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb Jun 24 00:31:25 devstack sudo[111715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:26 devstack sudo[111715]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb" returned: 0 in 0.886s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:26 devstack sudo[111721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb Jun 24 00:31:26 devstack sudo[111721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:27 devstack sudo[111721]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-00f08229-28fc-459b-8511-9178a5fc8deb" returned: 0 in 0.919s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-00f08229-28fc-459b-8511-9178a5fc8deb" released by "delete_volume" :: held 1.898s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Created reservations ['d8459481-4fe6-44c3-92fc-356baf67ecef', '3dd89814-d155-4f4e-a330-7301b716f623', 'a7ed568a-284d-4291-9622-a96fa3f264d4', '32a6e185-e46f-4831-8e0b-d46e41c0f29d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:27 devstack sudo[111724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:31:27 devstack sudo[111724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-39830dd5-7f05-41cc-a1ad-a8de2100dbf9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-39830dd5-7f05-41cc-a1ad-a8de2100dbf9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "cinder-quobyte-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8185c586-6695-47db-b468-49645e8b3f1b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:31:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:28 devstack sudo[111726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 Jun 24 00:31:28 devstack sudo[111726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:28 devstack sudo[111724]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.991s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:28 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:31:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Deleted volume successfully. Jun 24 00:31:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-86ea376b-5462-4a82-9bea-bb3df79e607e tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-00f08229-28fc-459b-8511-9178a5fc8deb-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:29 devstack sudo[111726]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" returned: 0 in 1.063s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:29 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9 Jun 24 00:31:29 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:29 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" returned: 0 in 0.836s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-quobyte-39830dd5-7f05-41cc-a1ad-a8de2100dbf9" released by "delete_volume" :: held 1.955s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Created reservations ['c1732b92-91a1-4650-a643-0210bb8557b1', 'c25c5446-4bc5-4edd-94e9-409865cbe03e', 'e7f43657-940e-4ad4-955c-c8007808b261', 'e51dcf0f-677d-4b49-9e5d-3032f9009258'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:30 devstack sudo[111736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:31:30 devstack sudo[111736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:30 devstack sudo[111736]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.803s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:31:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Deleted volume successfully. Jun 24 00:31:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-cb145649-9d15-4e4c-827d-38412662975d tempest-SnapshotDependencyTests-182400867 None] Lock "cinder-39830dd5-7f05-41cc-a1ad-a8de2100dbf9-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:31:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:31:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:39 devstack sudo[111745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:31:39 devstack sudo[111745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:40 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=48,cinder:INSERT=17,cinder:UPDATE=63,cinder:DELETE=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:31:40 devstack sudo[111745]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.783s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:31:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:31:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:31:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:31:40 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=40,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=8 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (73887c25-48dd-46e8-ab78-610da7335ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa50651-8ae7-4efb-ab44-f68774b713dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa50651-8ae7-4efb-ab44-f68774b713dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1816830655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1e1350-02b7-4b32-9136-93e368703c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:31:58Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9870ed-258a-4042-aea8-43c5bcbf1472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9870ed-258a-4042-aea8-43c5bcbf1472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98db32c-5d66-41bd-a6f2-ae615cda1f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98db32c-5d66-41bd-a6f2-ae615cda1f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1e1350-02b7-4b32-9136-93e368703c6f', 'volume_name': 'volume-0d1e1350-02b7-4b32-9136-93e368703c6f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d448aeb-a901-4fa8-b6f0-51faa9ea0c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d448aeb-a901-4fa8-b6f0-51faa9ea0c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5251bc12-0dd8-41e0-ac76-5813e504d216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Volume 0d1e1350-02b7-4b32-9136-93e368703c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1e1350-02b7-4b32-9136-93e368703c6f', 'volume_size': 1} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1816830655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1e1350-02b7-4b32-9136-93e368703c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:31:58Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Creating volume 0d1e1350-02b7-4b32-9136-93e368703c6f {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:31:57 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:31:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:57 devstack sudo[111862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f 1073741824 Jun 24 00:31:57 devstack sudo[111862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:58 devstack sudo[111862]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f 1073741824" returned: 0 in 0.830s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:31:58 devstack sudo[111867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f Jun 24 00:31:58 devstack sudo[111867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:31:59 devstack sudo[111867]: pam_unix(sudo:session): session closed for user root Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f" returned: 0 in 0.626s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5251bc12-0dd8-41e0-ac76-5813e504d216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1e1350-02b7-4b32-9136-93e368703c6f', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6835b084-bd77-4031-915f-ec7e0654b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:31:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Volume volume-0d1e1350-02b7-4b32-9136-93e368703c6f (0d1e1350-02b7-4b32-9136-93e368703c6f): created successfully Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6835b084-bd77-4031-915f-ec7e0654b602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (73887c25-48dd-46e8-ab78-610da7335ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:31:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a69754fe-55e7-43c3-8aff-33b2614853bd tempest-VolumesActionsTest-1991732783 None] Created volume successfully. Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c68e6309-1040-4a7d-8cae-fdc8cb78362c tempest-VolumesActionsTest-1991732783 None] Acquiring lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f" by "attach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:31:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c68e6309-1040-4a7d-8cae-fdc8cb78362c tempest-VolumesActionsTest-1991732783 None] Lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f" acquired by "attach_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:31:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c68e6309-1040-4a7d-8cae-fdc8cb78362c tempest-VolumesActionsTest-1991732783 None] Attaching volume 0d1e1350-02b7-4b32-9136-93e368703c6f to instance e9624772-dfc0-4e6a-a074-87863fb5afe6 at mountpoint /dev/vdb on host None. Jun 24 00:31:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c68e6309-1040-4a7d-8cae-fdc8cb78362c tempest-VolumesActionsTest-1991732783 None] Attach volume completed successfully. Jun 24 00:32:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c68e6309-1040-4a7d-8cae-fdc8cb78362c tempest-VolumesActionsTest-1991732783 None] Lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f" released by "attach_volume" :: held 0.091s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-316cbf75-b2db-4cec-86d6-24a2224aed52 tempest-VolumesActionsTest-2039760601 None] Terminate volume connection completed successfully. Jun 24 00:32:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-316cbf75-b2db-4cec-86d6-24a2224aed52 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-detach_volume" by "detach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-316cbf75-b2db-4cec-86d6-24a2224aed52 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-316cbf75-b2db-4cec-86d6-24a2224aed52 tempest-VolumesActionsTest-2039760601 None] Detaching volume 0d1e1350-02b7-4b32-9136-93e368703c6f from instance e9624772-dfc0-4e6a-a074-87863fb5afe6. Jun 24 00:32:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-316cbf75-b2db-4cec-86d6-24a2224aed52 tempest-VolumesActionsTest-2039760601 None] Detach volume completed successfully. Jun 24 00:32:01 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-316cbf75-b2db-4cec-86d6-24a2224aed52 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5809de6a-de5b-45aa-87b0-19722a6c40a0 tempest-VolumesActionsTest-1991732783 None] Acquiring lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-detach_volume" by "detach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5809de6a-de5b-45aa-87b0-19722a6c40a0 tempest-VolumesActionsTest-1991732783 None] Lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5809de6a-de5b-45aa-87b0-19722a6c40a0 tempest-VolumesActionsTest-1991732783 None] Volume detach called, but volume not attached. Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-5809de6a-de5b-45aa-87b0-19722a6c40a0 tempest-VolumesActionsTest-1991732783 None] Lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-detach_volume" released by "detach_volume" :: held 0.016s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Acquiring lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Acquiring lock "cinder-quobyte-0d1e1350-02b7-4b32-9136-93e368703c6f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Lock "cinder-quobyte-0d1e1350-02b7-4b32-9136-93e368703c6f" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41c36cb-5159-4557-b4b6-7fd6f419fc4d]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:03 devstack sudo[111870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f Jun 24 00:32:03 devstack sudo[111870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:03 devstack sudo[111870]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f" returned: 0 in 0.738s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:03 devstack sudo[111875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f Jun 24 00:32:03 devstack sudo[111875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:04 devstack sudo[111875]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0d1e1350-02b7-4b32-9136-93e368703c6f" returned: 0 in 0.634s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Lock "cinder-quobyte-0d1e1350-02b7-4b32-9136-93e368703c6f" released by "delete_volume" :: held 1.420s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Created reservations ['10af7a26-e16b-42b9-9d2c-3b0bc250f416', '4326ff80-07b2-4012-9761-3a133a7176f1', '5fb79032-01ce-4775-a98b-000c0154a1d9', 'a2efdcdb-fc51-4ede-a588-c87dbe02ebe7'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:04 devstack sudo[111878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:32:04 devstack sudo[111878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:05 devstack sudo[111878]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.631s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:05 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:32:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Deleted volume successfully. Jun 24 00:32:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1e1243ce-4e98-405a-a77f-4a40b164fe7d tempest-VolumesActionsTest-1991732783 None] Lock "cinder-0d1e1350-02b7-4b32-9136-93e368703c6f-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (214f829a-babf-4a1d-9c0f-793734e171e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2381f383-c352-4543-bb5c-832056a7a63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2381f383-c352-4543-bb5c-832056a7a63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-404215315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e928fe19-5fe4-4fea-828c-efe5585e4572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:13Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ed4cc1-53d0-426b-8586-f97df2b9a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ed4cc1-53d0-426b-8586-f97df2b9a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171abf8e-aec7-4768-a5d4-aff85a4ccf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171abf8e-aec7-4768-a5d4-aff85a4ccf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e928fe19-5fe4-4fea-828c-efe5585e4572', 'volume_name': 'volume-e928fe19-5fe4-4fea-828c-efe5585e4572', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1415220-741f-4ed1-8ddf-4576babaaa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1415220-741f-4ed1-8ddf-4576babaaa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098db5c7-f3ea-4ba3-a237-86a8c1cf25be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:13 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Volume e928fe19-5fe4-4fea-828c-efe5585e4572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e928fe19-5fe4-4fea-828c-efe5585e4572', 'volume_size': 1} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-404215315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e928fe19-5fe4-4fea-828c-efe5585e4572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:13Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Creating volume e928fe19-5fe4-4fea-828c-efe5585e4572 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:32:13 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:13 devstack sudo[111960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 1073741824 Jun 24 00:32:13 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:13 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 1073741824" returned: 0 in 0.774s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:13 devstack sudo[111965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 Jun 24 00:32:13 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:14 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572" returned: 0 in 0.595s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:32:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098db5c7-f3ea-4ba3-a237-86a8c1cf25be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e928fe19-5fe4-4fea-828c-efe5585e4572', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a502569-e364-4934-b53f-62dc6ad7f5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Volume volume-e928fe19-5fe4-4fea-828c-efe5585e4572 (e928fe19-5fe4-4fea-828c-efe5585e4572): created successfully Jun 24 00:32:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a502569-e364-4934-b53f-62dc6ad7f5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (214f829a-babf-4a1d-9c0f-793734e171e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8430db4e-088c-44e6-bdf8-9976c8490729 tempest-VolumesActionsTest-1991732783 None] Created volume successfully. Jun 24 00:32:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-e928fe19-5fe4-4fea-828c-efe5585e4572-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-e928fe19-5fe4-4fea-828c-efe5585e4572-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-quobyte-e928fe19-5fe4-4fea-828c-efe5585e4572" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-quobyte-e928fe19-5fe4-4fea-828c-efe5585e4572" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a643515-347a-49aa-93c6-6a0752b748c2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:15 devstack sudo[111969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 Jun 24 00:32:15 devstack sudo[111969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:15 devstack sudo[111969]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572" returned: 0 in 0.745s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:15 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572 Jun 24 00:32:15 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:16 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e928fe19-5fe4-4fea-828c-efe5585e4572" returned: 0 in 0.649s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-quobyte-e928fe19-5fe4-4fea-828c-efe5585e4572" released by "delete_volume" :: held 1.429s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Created reservations ['eecc579e-b153-4a1b-aee4-72c344b7b2b4', 'f99600cf-6259-4c29-8c32-b011905c24b5', '2928f25b-3384-4216-b465-024ed43e0d87', '771b7939-5fdc-4a44-a1bf-6bc915704bde'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:16 devstack sudo[111978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:32:16 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:17 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.663s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:32:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Deleted volume successfully. Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0d6f0630-2eb1-4902-ae8b-4d0c6a4534d2 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-e928fe19-5fe4-4fea-828c-efe5585e4572-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (538f0f91-62b5-421b-8e69-32b1393b829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc961cfa-84d2-4f1b-961a-217e26de4aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc961cfa-84d2-4f1b-961a-217e26de4aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-685982392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0191872e-e498-49a7-b02d-aaad6b71815c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:18Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13daa57-aff0-4760-91bf-4d4314b7d1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13daa57-aff0-4760-91bf-4d4314b7d1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e9dbbd-ff47-49b8-93e1-f8ee8c4c338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e9dbbd-ff47-49b8-93e1-f8ee8c4c338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0191872e-e498-49a7-b02d-aaad6b71815c', 'volume_name': 'volume-0191872e-e498-49a7-b02d-aaad6b71815c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f644d2-1559-4545-803f-f0ba543f78ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f644d2-1559-4545-803f-f0ba543f78ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34473234-f23b-4d85-bb39-928bcac46c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Volume 0191872e-e498-49a7-b02d-aaad6b71815c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0191872e-e498-49a7-b02d-aaad6b71815c', 'volume_size': 1} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-685982392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0191872e-e498-49a7-b02d-aaad6b71815c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:18Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Creating volume 0191872e-e498-49a7-b02d-aaad6b71815c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:32:17 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:32:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:17 devstack sudo[111983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c 1073741824 Jun 24 00:32:17 devstack sudo[111983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:18 devstack sudo[111983]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c 1073741824" returned: 0 in 0.832s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:18 devstack sudo[111988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c Jun 24 00:32:18 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:19 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c" returned: 0 in 0.646s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:32:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34473234-f23b-4d85-bb39-928bcac46c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0191872e-e498-49a7-b02d-aaad6b71815c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd72779e-f982-4103-8719-6d72b327beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Volume volume-0191872e-e498-49a7-b02d-aaad6b71815c (0191872e-e498-49a7-b02d-aaad6b71815c): created successfully Jun 24 00:32:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd72779e-f982-4103-8719-6d72b327beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (538f0f91-62b5-421b-8e69-32b1393b829b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7a286266-e46a-4ee3-af47-c75eb8e762e7 tempest-VolumesActionsTest-1991732783 None] Created volume successfully. Jun 24 00:32:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-0191872e-e498-49a7-b02d-aaad6b71815c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Lock "cinder-0191872e-e498-49a7-b02d-aaad6b71815c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-quobyte-0191872e-e498-49a7-b02d-aaad6b71815c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Lock "cinder-quobyte-0191872e-e498-49a7-b02d-aaad6b71815c" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eadcea0-ea08-4df0-99c6-c933af27a232]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:20 devstack sudo[111992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c Jun 24 00:32:20 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:20 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c" returned: 0 in 0.790s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:20 devstack sudo[111997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c Jun 24 00:32:20 devstack sudo[111997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:21 devstack sudo[111997]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-0191872e-e498-49a7-b02d-aaad6b71815c" returned: 0 in 0.644s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Lock "cinder-quobyte-0191872e-e498-49a7-b02d-aaad6b71815c" released by "delete_volume" :: held 1.473s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Created reservations ['20778453-a8b1-4794-a171-1e98c2450e8e', '382a4a7c-cfeb-4588-bdb3-523a12a05173', 'f8baa06c-0d0e-4d97-9b82-596619109912', 'cff317bf-d340-484c-b7e6-f45e4eb885a1'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:21 devstack sudo[112000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:32:21 devstack sudo[112000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:22 devstack sudo[112000]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.629s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:32:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Deleted volume successfully. Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9fdfd1d5-874e-4ea6-957e-9d718bb47dcc tempest-VolumesActionsTest-2039760601 None] Lock "cinder-0191872e-e498-49a7-b02d-aaad6b71815c-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (4fa66a65-d9b9-4c33-b17d-6b51a8601e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d241666e-c509-4e37-9ef3-46da19ce4d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d241666e-c509-4e37-9ef3-46da19ce4d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-759127036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56e2d3e-8590-4d34-9bad-c71b30c2f39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:23Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d1cdf4-92fe-4756-8a18-20671fe39835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d1cdf4-92fe-4756-8a18-20671fe39835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f3dd7f-94f7-4cb2-8e14-005dd28706a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f3dd7f-94f7-4cb2-8e14-005dd28706a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56e2d3e-8590-4d34-9bad-c71b30c2f39c', 'volume_name': 'volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc310244-7e16-436d-bad1-c723d323e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc310244-7e16-436d-bad1-c723d323e052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48400810-8ded-428f-a533-d467131b6b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Volume d56e2d3e-8590-4d34-9bad-c71b30c2f39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c', 'volume_size': 1} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-759127036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56e2d3e-8590-4d34-9bad-c71b30c2f39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:23Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Creating volume d56e2d3e-8590-4d34-9bad-c71b30c2f39c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:32:22 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:32:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:22 devstack sudo[112003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c 1073741824 Jun 24 00:32:22 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:23 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c 1073741824" returned: 0 in 0.787s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:23 devstack sudo[112008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c Jun 24 00:32:23 devstack sudo[112008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:24 devstack sudo[112008]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c" returned: 0 in 0.645s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:32:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48400810-8ded-428f-a533-d467131b6b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d71179-60db-47c9-a16d-b197155b4523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Volume volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c (d56e2d3e-8590-4d34-9bad-c71b30c2f39c): created successfully Jun 24 00:32:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d71179-60db-47c9-a16d-b197155b4523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (4fa66a65-d9b9-4c33-b17d-6b51a8601e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-49f6ac9b-f03c-4e66-9c89-ef9287529f3c tempest-VolumesActionsTest-1991732783 None] Created volume successfully. Jun 24 00:32:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-d56e2d3e-8590-4d34-9bad-c71b30c2f39c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-d56e2d3e-8590-4d34-9bad-c71b30c2f39c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-quobyte-d56e2d3e-8590-4d34-9bad-c71b30c2f39c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-quobyte-d56e2d3e-8590-4d34-9bad-c71b30c2f39c" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[106dbf50-b371-48e0-812c-b2c8b6e0992f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:25 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c Jun 24 00:32:25 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:25 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c" returned: 0 in 0.761s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:25 devstack sudo[112016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c Jun 24 00:32:25 devstack sudo[112016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:26 devstack sudo[112016]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-d56e2d3e-8590-4d34-9bad-c71b30c2f39c" returned: 0 in 0.653s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-quobyte-d56e2d3e-8590-4d34-9bad-c71b30c2f39c" released by "delete_volume" :: held 1.451s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Created reservations ['790bbb2c-1298-4cb7-8a69-06a989b52cbb', '782d2236-955b-4b4c-96c8-84e7a3e9c893', 'd934cc8c-aef7-48ce-8c5f-b5382071c73e', '0c480391-85ba-4274-ac07-4fd5f46fe90d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:26 devstack sudo[112020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:32:26 devstack sudo[112020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:27 devstack sudo[112020]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.635s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:32:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Deleted volume successfully. Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-bcb45532-61bb-4c8a-b890-b5f9a4bbee58 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-d56e2d3e-8590-4d34-9bad-c71b30c2f39c-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (52ae334f-2931-45d7-87c2-776b3feb675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d1ce71-de15-4fb3-a46e-303ed63e2cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d1ce71-de15-4fb3-a46e-303ed63e2cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1084504114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801406cc-7b80-4eda-8fa3-1c51510532e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:28Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7dbaa4-290b-4ed6-8b25-b3bcc015e97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7dbaa4-290b-4ed6-8b25-b3bcc015e97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (131fb499-740a-4e3d-ae71-0dca997ad96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (131fb499-740a-4e3d-ae71-0dca997ad96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801406cc-7b80-4eda-8fa3-1c51510532e3', 'volume_name': 'volume-801406cc-7b80-4eda-8fa3-1c51510532e3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b4c109-7981-46e1-a953-ed35a70bca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b4c109-7981-46e1-a953-ed35a70bca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb85e42-2f3c-466e-9c86-c36dee4c7711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Volume 801406cc-7b80-4eda-8fa3-1c51510532e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801406cc-7b80-4eda-8fa3-1c51510532e3', 'volume_size': 1} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1084504114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801406cc-7b80-4eda-8fa3-1c51510532e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:28Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Creating volume 801406cc-7b80-4eda-8fa3-1c51510532e3 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:32:27 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:32:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:27 devstack sudo[112023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 1073741824 Jun 24 00:32:27 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:28 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 1073741824" returned: 0 in 0.820s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:28 devstack sudo[112028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 Jun 24 00:32:28 devstack sudo[112028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:29 devstack sudo[112028]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3" returned: 0 in 0.648s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb85e42-2f3c-466e-9c86-c36dee4c7711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801406cc-7b80-4eda-8fa3-1c51510532e3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7ffb1f-5df0-4c9d-9ab5-006487591e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:29 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Volume volume-801406cc-7b80-4eda-8fa3-1c51510532e3 (801406cc-7b80-4eda-8fa3-1c51510532e3): created successfully Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7ffb1f-5df0-4c9d-9ab5-006487591e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (52ae334f-2931-45d7-87c2-776b3feb675d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:29 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e39183d6-5ac7-4d85-840d-45643589abbc tempest-VolumesActionsTest-1991732783 None] Created volume successfully. Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-801406cc-7b80-4eda-8fa3-1c51510532e3-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-801406cc-7b80-4eda-8fa3-1c51510532e3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "cinder-quobyte-801406cc-7b80-4eda-8fa3-1c51510532e3" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-quobyte-801406cc-7b80-4eda-8fa3-1c51510532e3" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2322ebb4-60ea-478f-8556-195987e81c09]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:30 devstack sudo[112031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 Jun 24 00:32:30 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:30 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3" returned: 0 in 0.756s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:30 devstack sudo[112036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3 Jun 24 00:32:30 devstack sudo[112036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:31 devstack sudo[112036]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-801406cc-7b80-4eda-8fa3-1c51510532e3" returned: 0 in 0.637s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-quobyte-801406cc-7b80-4eda-8fa3-1c51510532e3" released by "delete_volume" :: held 1.433s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Created reservations ['9ced6e65-b785-43ed-a899-cf2bedb856e9', '5dce586c-f234-4dc1-81ae-ba1c2c452362', 'd2561cbc-40ec-4996-89a2-b12a40f1f513', '85ca59d7-4ea4-4a40-9e37-5f19d5b2831f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:31 devstack sudo[112039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:32:31 devstack sudo[112039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:32 devstack sudo[112039]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.606s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:32:32 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Deleted volume successfully. Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7fc64e70-a55b-4a61-bb8f-add4081f5b89 tempest-VolumesActionsTest-2039760601 None] Lock "cinder-801406cc-7b80-4eda-8fa3-1c51510532e3-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (5bf0fd8b-f743-46a1-92b4-8811507e6fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dc4c23-397e-4187-8e9e-76ba5cd9720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dc4c23-397e-4187-8e9e-76ba5cd9720f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-882475319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48faeba6-3b94-4cba-b86e-644ebb23ad2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:33Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53037e2e-1ac8-40d3-a3e4-8d6d6f9564b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53037e2e-1ac8-40d3-a3e4-8d6d6f9564b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b44ad6-c63d-4996-9162-79872540642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b44ad6-c63d-4996-9162-79872540642d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48faeba6-3b94-4cba-b86e-644ebb23ad2a', 'volume_name': 'volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb30fce0-ab16-4040-88b9-e392f8e08382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb30fce0-ab16-4040-88b9-e392f8e08382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a0ef9b-5356-4fa0-ae63-941ea2ada541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Volume 48faeba6-3b94-4cba-b86e-644ebb23ad2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a', 'volume_size': 1} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-882475319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48faeba6-3b94-4cba-b86e-644ebb23ad2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cc0c981fe24a8f9875f52a8de5b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:33Z,use_quota=True,user_id='0b47e0c53c0f4b01a8dd3f2996e019ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Creating volume 48faeba6-3b94-4cba-b86e-644ebb23ad2a {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:32:32 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:32:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:32 devstack sudo[112042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a 1073741824 Jun 24 00:32:32 devstack sudo[112042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:33 devstack sudo[112042]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a 1073741824" returned: 0 in 0.780s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:33 devstack sudo[112047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a Jun 24 00:32:33 devstack sudo[112047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:34 devstack sudo[112047]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a" returned: 0 in 0.668s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:32:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a0ef9b-5356-4fa0-ae63-941ea2ada541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5addc23a-09ed-4aea-bb91-61feede03e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:34 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Volume volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a (48faeba6-3b94-4cba-b86e-644ebb23ad2a): created successfully Jun 24 00:32:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5addc23a-09ed-4aea-bb91-61feede03e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:34 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Flow 'volume_create_manager' (5bf0fd8b-f743-46a1-92b4-8811507e6fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-902a840f-f4c0-47cc-91a4-7b5331d2eada tempest-VolumesActionsTest-1991732783 None] Created volume successfully. Jun 24 00:32:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Acquiring lock "cinder-48faeba6-3b94-4cba-b86e-644ebb23ad2a-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Lock "cinder-48faeba6-3b94-4cba-b86e-644ebb23ad2a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Acquiring lock "cinder-quobyte-48faeba6-3b94-4cba-b86e-644ebb23ad2a" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Lock "cinder-quobyte-48faeba6-3b94-4cba-b86e-644ebb23ad2a" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[376204ba-9149-462a-91b5-b1ddfbeb6ef9]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:35 devstack sudo[112050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a Jun 24 00:32:35 devstack sudo[112050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:36 devstack sudo[112050]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a" returned: 0 in 0.734s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:36 devstack sudo[112055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a Jun 24 00:32:36 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:36 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-48faeba6-3b94-4cba-b86e-644ebb23ad2a" returned: 0 in 0.645s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Lock "cinder-quobyte-48faeba6-3b94-4cba-b86e-644ebb23ad2a" released by "delete_volume" :: held 1.419s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Created reservations ['3c835074-1378-49c5-9c96-5d34ad15132e', '45631693-1574-41af-9436-0dd86a6038cb', '2a1a3e03-f2d4-460f-9da0-0543831006cc', 'ab61c413-597a-41fc-a078-e4ae79fd0f5c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:36 devstack sudo[112059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:32:36 devstack sudo[112059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:37 devstack sudo[112059]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.623s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:37 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:32:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Deleted volume successfully. Jun 24 00:32:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b74e7b84-a02c-4b93-92d0-836d308e62f2 tempest-VolumesActionsTest-1991732783 None] Lock "cinder-48faeba6-3b94-4cba-b86e-644ebb23ad2a-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:32:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:32:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:39 devstack sudo[112064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:32:39 devstack sudo[112064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:40 devstack sudo[112064]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.686s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:32:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:32:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:32:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:32:46 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=69,cinder:SELECT=47,cinder:INSERT=17,cinder:DELETE=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:32:47 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=50,cinder:UPDATE=71,cinder:INSERT=15,cinder:DELETE=7 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Flow 'volume_create_manager' (5cf449e5-1ec0-4556-8fbf-21534590e1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec32d27-b705-4297-95e5-b62225084071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec32d27-b705-4297-95e5-b62225084071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1995681125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce49c8c-a414-4ef7-99c7-adc92c66ce46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d11b94720274ea5989b10fcbb6d29d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:49Z,use_quota=True,user_id='68a780ceef594c8287f6a8b32133c1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef93e3f-9996-4dbd-a324-03f58c8302af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef93e3f-9996-4dbd-a324-03f58c8302af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb12760a-bdcd-4985-9d16-888de5f46b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb12760a-bdcd-4985-9d16-888de5f46b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce49c8c-a414-4ef7-99c7-adc92c66ce46', 'volume_name': 'volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4118a3a-5361-454c-9024-6229d0bb9bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4118a3a-5361-454c-9024-6229d0bb9bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df13306d-f975-4c23-b169-234386357bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Volume 6ce49c8c-a414-4ef7-99c7-adc92c66ce46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46', 'volume_size': 1} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1995681125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce49c8c-a414-4ef7-99c7-adc92c66ce46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d11b94720274ea5989b10fcbb6d29d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:32:49Z,use_quota=True,user_id='68a780ceef594c8287f6a8b32133c1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Creating volume 6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:32:49 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:32:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:49 devstack sudo[112077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 1073741824 Jun 24 00:32:49 devstack sudo[112077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:50 devstack sudo[112077]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 1073741824" returned: 0 in 0.777s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:50 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 Jun 24 00:32:50 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:50 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" returned: 0 in 0.604s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df13306d-f975-4c23-b169-234386357bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1bb608-5cd4-4804-9bd2-a4a82bb3b3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:32:50 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Volume volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 (6ce49c8c-a414-4ef7-99c7-adc92c66ce46): created successfully Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1bb608-5cd4-4804-9bd2-a4a82bb3b3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:32:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Flow 'volume_create_manager' (5cf449e5-1ec0-4556-8fbf-21534590e1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:32:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-15b87f7f-82fa-4888-90ec-09f5b7ec3549 tempest-VolumesDeleteCascade-298846265 None] Created volume successfully. Jun 24 00:32:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Creating offline snapshot a8a559d2-ee69-49c2-92d5-15ed618d0ff6 of volume 6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:32:51 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dce704-eb4f-4e6a-bb99-3f2a5e0dad04]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:51 devstack sudo[112086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 Jun 24 00:32:51 devstack sudo[112086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:52 devstack sudo[112086]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" returned: 0 in 0.754s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:52 devstack sudo[112091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 1G Jun 24 00:32:52 devstack sudo[112091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:53 devstack sudo[112091]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 1G" returned: 0 in 0.737s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:53 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 Jun 24 00:32:53 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:53 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6" returned: 0 in 0.642s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:53 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 is being set with open permissions: ugo+rw Jun 24 00:32:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:53 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 Jun 24 00:32:53 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:54 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6" returned: 0 in 0.605s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:54 devstack sudo[112105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.info Jun 24 00:32:54 devstack sudo[112105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:54 devstack sudo[112105]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.info" returned: 0 in 0.610s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:54 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.info is being set with open permissions: ugo+rw Jun 24 00:32:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:54 devstack sudo[112108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.info Jun 24 00:32:55 devstack sudo[112108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:55 devstack sudo[112108]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.info" returned: 0 in 0.598s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.031s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-8db62b91-4062-4848-a3f6-68d247392c63 tempest-VolumesDeleteCascade-298846265 None] Create snapshot completed successfully Jun 24 00:32:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:32:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:32:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Creating offline snapshot 8c5894e7-3b1b-4869-9e90-c9a6fa414902 of volume 6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:32:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1fd577-faf1-44e0-9716-bd5d51555f5f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:56 devstack sudo[112111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 Jun 24 00:32:56 devstack sudo[112111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:56 devstack sudo[112111]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6" returned: 0 in 0.743s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:32:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:56 devstack sudo[112117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 1G Jun 24 00:32:56 devstack sudo[112117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:57 devstack sudo[112117]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 1G" returned: 0 in 0.789s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:57 devstack sudo[112123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 Jun 24 00:32:57 devstack sudo[112123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:58 devstack sudo[112123]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902" returned: 0 in 0.641s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:58 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 is being set with open permissions: ugo+rw Jun 24 00:32:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:58 devstack sudo[112128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 Jun 24 00:32:58 devstack sudo[112128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:58 devstack sudo[112128]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902" returned: 0 in 0.619s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.907s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:32:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e43f4a32-c7c5-40c2-a1ac-965c6283065f tempest-VolumesDeleteCascade-298846265 None] Create snapshot completed successfully Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-6ce49c8c-a414-4ef7-99c7-adc92c66ce46-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-6ce49c8c-a414-4ef7-99c7-adc92c66ce46-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Performing cascade delete. {{(pid=94472) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-8c5894e7-3b1b-4869-9e90-c9a6fa414902-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-8c5894e7-3b1b-4869-9e90-c9a6fa414902-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-8c5894e7-3b1b-4869-9e90-c9a6fa414902" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-8c5894e7-3b1b-4869-9e90-c9a6fa414902" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Deleting offline snapshot 8c5894e7-3b1b-4869-9e90-c9a6fa414902 of volume 6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] snapshot_file for this snap is: volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fd6699-8a02-463f-9dd6-dc52a3d509c2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:32:59 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 Jun 24 00:32:59 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:32:59 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902" returned: 0 in 0.713s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[388e252f-2016-431a-88e3-36d475df6e6b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:32:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:00 devstack sudo[112136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 Jun 24 00:33:00 devstack sudo[112136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:00 devstack sudo[112136]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6" returned: 0 in 0.702s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:33:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:00 devstack sudo[112141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 Jun 24 00:33:00 devstack sudo[112141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:01 devstack sudo[112141]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902" returned: 0 in 0.769s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:01 devstack sudo[112146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902 Jun 24 00:33:01 devstack sudo[112146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:02 devstack sudo[112146]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.8c5894e7-3b1b-4869-9e90-c9a6fa414902" returned: 0 in 0.611s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-8c5894e7-3b1b-4869-9e90-c9a6fa414902" released by "_delete_snapshot" :: held 2.892s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" released by "delete_snapshot" :: held 2.919s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Created reservations ['71c7f388-fa13-4a36-ba2d-de8250bbb85e', '7c3c3ff9-a8de-48de-9cde-a04be2c7d0db', '850a5d38-b3e4-4cfd-b437-de1b6264c717', '8192801a-5779-4b7b-af53-bf91596394fb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:33:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Delete snapshot completed successfully. Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-8c5894e7-3b1b-4869-9e90-c9a6fa414902-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-a8a559d2-ee69-49c2-92d5-15ed618d0ff6-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-a8a559d2-ee69-49c2-92d5-15ed618d0ff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-a8a559d2-ee69-49c2-92d5-15ed618d0ff6" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-a8a559d2-ee69-49c2-92d5-15ed618d0ff6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Deleting offline snapshot a8a559d2-ee69-49c2-92d5-15ed618d0ff6 of volume 6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] snapshot_file for this snap is: volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[df38101d-9201-4594-b2bf-82f062515347]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:02 devstack sudo[112149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 Jun 24 00:33:02 devstack sudo[112149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:03 devstack sudo[112149]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6" returned: 0 in 0.728s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:33:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f26580-862b-499d-bc8c-af791074d335]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:03 devstack sudo[112154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 Jun 24 00:33:03 devstack sudo[112154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:03 devstack sudo[112154]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" returned: 0 in 0.729s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:03 devstack sudo[112159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 Jun 24 00:33:03 devstack sudo[112159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:04 devstack sudo[112159]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6" returned: 0 in 0.694s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:04 devstack sudo[112165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6 Jun 24 00:33:04 devstack sudo[112165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:05 devstack sudo[112165]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46.a8a559d2-ee69-49c2-92d5-15ed618d0ff6" returned: 0 in 0.622s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-a8a559d2-ee69-49c2-92d5-15ed618d0ff6" released by "_delete_snapshot" :: held 2.859s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" released by "delete_snapshot" :: held 2.879s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Created reservations ['ff0ec7a3-d4c2-43e8-944e-e7df84f0b3b9', 'ecddb9f6-071e-4151-ac3a-71db285ccea4', '9185a121-4d53-458e-95f5-8e27e78e88a9', '6a49a89f-6f97-45c9-bd4d-8c4c73fe36b2'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:33:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Delete snapshot completed successfully. Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-a8a559d2-ee69-49c2-92d5-15ed618d0ff6-delete_snapshot" released by "delete_snapshot" :: held 3.011s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Snapshots deleted, issuing volume delete {{(pid=94472) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fc10e5-cb3b-4c97-90da-acd3d6ab6558]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:05 devstack sudo[112168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 Jun 24 00:33:05 devstack sudo[112168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:06 devstack sudo[112168]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" returned: 0 in 0.741s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:06 devstack sudo[112173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46 Jun 24 00:33:06 devstack sudo[112173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:06 devstack sudo[112173]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" returned: 0 in 0.619s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-6ce49c8c-a414-4ef7-99c7-adc92c66ce46" released by "delete_volume" :: held 1.413s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Created reservations ['ce697b9b-f398-4f87-8895-5743b5a02db4', 'fc2f11c4-fcb5-4687-b23f-9233230fd7ef', '318dd44a-c0a7-4502-aad4-503b574233db', 'f1496a69-a483-410c-88d2-d2ccbdf9fce4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:06 devstack sudo[112177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:33:06 devstack sudo[112177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:07 devstack sudo[112177]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.627s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:07 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:33:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Deleted volume successfully. Jun 24 00:33:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ac4b9e9c-2128-4250-a6a7-72e7078674be tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-6ce49c8c-a414-4ef7-99c7-adc92c66ce46-delete_volume" released by "delete_volume" :: held 8.349s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Flow 'volume_create_manager' (2739d23d-ca2a-482e-bffa-e96ffe36137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae98393f-ae26-47a0-87dc-d317ee446129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae98393f-ae26-47a0-87dc-d317ee446129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1905163575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f04c3f5-239a-405f-972e-f338c1e21096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d11b94720274ea5989b10fcbb6d29d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:33:08Z,use_quota=True,user_id='68a780ceef594c8287f6a8b32133c1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c78d908-9a5c-4cbc-8ace-5aaa3d9c7bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c78d908-9a5c-4cbc-8ace-5aaa3d9c7bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1ef9d2-ae96-4f5e-ac96-b88d2db65df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1ef9d2-ae96-4f5e-ac96-b88d2db65df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f04c3f5-239a-405f-972e-f338c1e21096', 'volume_name': 'volume-7f04c3f5-239a-405f-972e-f338c1e21096', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da78a75d-51c0-44ea-8780-b723320c326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da78a75d-51c0-44ea-8780-b723320c326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95d0691-4b7d-44c0-b327-b630f58397b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Volume 7f04c3f5-239a-405f-972e-f338c1e21096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f04c3f5-239a-405f-972e-f338c1e21096', 'volume_size': 1} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1905163575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f04c3f5-239a-405f-972e-f338c1e21096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d11b94720274ea5989b10fcbb6d29d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:33:08Z,use_quota=True,user_id='68a780ceef594c8287f6a8b32133c1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Creating volume 7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:33:08 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:33:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:08 devstack sudo[112180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 1073741824 Jun 24 00:33:08 devstack sudo[112180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:09 devstack sudo[112180]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 1073741824" returned: 0 in 0.770s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:09 devstack sudo[112185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 Jun 24 00:33:09 devstack sudo[112185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:09 devstack sudo[112185]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096" returned: 0 in 0.601s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95d0691-4b7d-44c0-b327-b630f58397b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f04c3f5-239a-405f-972e-f338c1e21096', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3cce66-27c4-44a6-8f80-a1953cf61b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Volume volume-7f04c3f5-239a-405f-972e-f338c1e21096 (7f04c3f5-239a-405f-972e-f338c1e21096): created successfully Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3cce66-27c4-44a6-8f80-a1953cf61b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Flow 'volume_create_manager' (2739d23d-ca2a-482e-bffa-e96ffe36137d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:33:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e2f3666d-9e17-49c8-8c76-bec010a18d6b tempest-VolumesDeleteCascade-298846265 None] Created volume successfully. Jun 24 00:33:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Creating offline snapshot 2b0ba206-c6f5-438a-a051-0d42e08e54ba of volume 7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:33:10 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a7699-bf76-4137-a576-5475505e2231]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:10 devstack sudo[112189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 Jun 24 00:33:10 devstack sudo[112189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:11 devstack sudo[112189]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096" returned: 0 in 0.746s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:11 devstack sudo[112230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba 1G Jun 24 00:33:11 devstack sudo[112230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:11 devstack sudo[112230]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba 1G" returned: 0 in 0.744s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f04c3f5-239a-405f-972e-f338c1e21096 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:11 devstack sudo[112235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f04c3f5-239a-405f-972e-f338c1e21096 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba Jun 24 00:33:11 devstack sudo[112235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:12 devstack sudo[112235]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f04c3f5-239a-405f-972e-f338c1e21096 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba" returned: 0 in 0.656s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:12 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba is being set with open permissions: ugo+rw Jun 24 00:33:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:12 devstack sudo[112241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba Jun 24 00:33:12 devstack sudo[112241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:13 devstack sudo[112241]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba" returned: 0 in 0.616s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:13 devstack sudo[112244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.info Jun 24 00:33:13 devstack sudo[112244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:13 devstack sudo[112244]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.info" returned: 0 in 0.620s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:13 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.info is being set with open permissions: ugo+rw Jun 24 00:33:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:13 devstack sudo[112247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.info Jun 24 00:33:13 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:14 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.info" returned: 0 in 0.623s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.089s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b13f86e2-a6e2-476e-bce1-7ba771f89201 tempest-VolumesDeleteCascade-298846265 None] Create snapshot completed successfully Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Flow 'volume_create_manager' (a2c30d70-01c3-43e3-804b-6032fe9db0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e382bcb2-460e-4b75-abf2-1a3b844e338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e382bcb2-460e-4b75-abf2-1a3b844e338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1504540471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f838667c-c3ef-46f1-99b8-c4696092e17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d11b94720274ea5989b10fcbb6d29d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b0ba206-c6f5-438a-a051-0d42e08e54ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:33:16Z,use_quota=True,user_id='68a780ceef594c8287f6a8b32133c1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63fa1d5-a6af-4224-9801-a94da0502fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63fa1d5-a6af-4224-9801-a94da0502fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd706e86-eb97-4375-a5b9-d4ad9fe3c7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd706e86-eb97-4375-a5b9-d4ad9fe3c7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f838667c-c3ef-46f1-99b8-c4696092e17a', 'volume_name': 'volume-f838667c-c3ef-46f1-99b8-c4696092e17a', 'volume_size': 1, 'snapshot_id': '2b0ba206-c6f5-438a-a051-0d42e08e54ba'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9649271c-8df2-4d16-8945-b8301833662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9649271c-8df2-4d16-8945-b8301833662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1432324c-5792-460c-8713-dd2be272a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:16 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Volume f838667c-c3ef-46f1-99b8-c4696092e17a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f838667c-c3ef-46f1-99b8-c4696092e17a', 'volume_size': 1, 'snapshot_id': '2b0ba206-c6f5-438a-a051-0d42e08e54ba'} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-2b0ba206-c6f5-438a-a051-0d42e08e54ba-f838667c-c3ef-46f1-99b8-c4696092e17a" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-2b0ba206-c6f5-438a-a051-0d42e08e54ba-f838667c-c3ef-46f1-99b8-c4696092e17a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Creating volume f838667c-c3ef-46f1-99b8-c4696092e17a from snapshot 2b0ba206-c6f5-438a-a051-0d42e08e54ba {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-f838667c-c3ef-46f1-99b8-c4696092e17a" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-f838667c-c3ef-46f1-99b8-c4696092e17a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] snapshot: 2b0ba206-c6f5-438a-a051-0d42e08e54ba, volume: f838667c-c3ef-46f1-99b8-c4696092e17a, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cc9d8a-e09e-4dda-b72d-5625e5e93e91]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:16 devstack sudo[112252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba Jun 24 00:33:16 devstack sudo[112252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:16 devstack sudo[112252]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba" returned: 0 in 0.710s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f04c3f5-239a-405f-972e-f338c1e21096(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55f846-a973-4836-bed2-82b84f6a2ca8]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:17 devstack sudo[112257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 Jun 24 00:33:17 devstack sudo[112257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:17 devstack sudo[112257]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096" returned: 0 in 0.706s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:17 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:33:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:17 devstack sudo[112262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a Jun 24 00:33:17 devstack sudo[112262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:21 devstack sudo[112262]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a" returned: 0 in 4.135s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c342cb61-5ec6-4c65-95f9-64dadeafc629]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:21 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 Jun 24 00:33:21 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:22 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096" returned: 0 in 0.902s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:22 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:33:22 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Converted 1024.00 MB image at 247.53 MB/s Jun 24 00:33:22 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a is being set with open permissions: ugo+rw Jun 24 00:33:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:22 devstack sudo[112285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a Jun 24 00:33:22 devstack sudo[112285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:23 devstack sudo[112285]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a" returned: 0 in 0.680s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-f838667c-c3ef-46f1-99b8-c4696092e17a" released by "_copy_volume_from_snapshot" :: held 7.220s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-2b0ba206-c6f5-438a-a051-0d42e08e54ba-f838667c-c3ef-46f1-99b8-c4696092e17a" released by "_create_volume_from_snapshot" :: held 7.248s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.268s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1432324c-5792-460c-8713-dd2be272a398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f838667c-c3ef-46f1-99b8-c4696092e17a', 'volume_size': 1, 'snapshot_id': '2b0ba206-c6f5-438a-a051-0d42e08e54ba'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739599cd-f8fe-4093-a727-ae83afca671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Volume volume-f838667c-c3ef-46f1-99b8-c4696092e17a (f838667c-c3ef-46f1-99b8-c4696092e17a): created successfully Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739599cd-f8fe-4093-a727-ae83afca671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Flow 'volume_create_manager' (a2c30d70-01c3-43e3-804b-6032fe9db0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:33:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ce8584d6-9719-48d2-ade7-6dfddce9ce88 tempest-VolumesDeleteCascade-298846265 None] Created volume successfully. Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-7f04c3f5-239a-405f-972e-f338c1e21096-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-7f04c3f5-239a-405f-972e-f338c1e21096-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Performing cascade delete. {{(pid=94472) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-2b0ba206-c6f5-438a-a051-0d42e08e54ba-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-2b0ba206-c6f5-438a-a051-0d42e08e54ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-7f04c3f5-239a-405f-972e-f338c1e21096" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-7f04c3f5-239a-405f-972e-f338c1e21096" acquired by "delete_snapshot" :: waited 0.012s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-2b0ba206-c6f5-438a-a051-0d42e08e54ba" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-2b0ba206-c6f5-438a-a051-0d42e08e54ba" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Deleting offline snapshot 2b0ba206-c6f5-438a-a051-0d42e08e54ba of volume 7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] snapshot_file for this snap is: volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc190b-903f-4283-8f2f-f3bd192659b3]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:23 devstack sudo[112288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba Jun 24 00:33:23 devstack sudo[112288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:24 devstack sudo[112288]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba" returned: 0 in 0.741s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f04c3f5-239a-405f-972e-f338c1e21096(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:33:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc577b2-ebb5-4033-8ddc-a65bb2321783]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:24 devstack sudo[112293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 Jun 24 00:33:24 devstack sudo[112293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:25 devstack sudo[112293]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096" returned: 0 in 0.735s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:25 devstack sudo[112298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba Jun 24 00:33:25 devstack sudo[112298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:26 devstack sudo[112298]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba" returned: 0 in 0.699s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:26 devstack sudo[112303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba Jun 24 00:33:26 devstack sudo[112303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:26 devstack sudo[112303]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096.2b0ba206-c6f5-438a-a051-0d42e08e54ba" returned: 0 in 0.601s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-2b0ba206-c6f5-438a-a051-0d42e08e54ba" released by "_delete_snapshot" :: held 2.860s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-7f04c3f5-239a-405f-972e-f338c1e21096" released by "delete_snapshot" :: held 2.880s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Created reservations ['d9f54512-c32e-4ddf-9a3f-c81d1431c627', '221e7900-7aba-4720-a11e-5ee8f4240831', '47723a1c-4a25-4ad8-8414-9c28a9a57dce', '728ca39a-021e-4e77-a628-5cef6ce99521'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:33:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Delete snapshot completed successfully. Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-2b0ba206-c6f5-438a-a051-0d42e08e54ba-delete_snapshot" released by "delete_snapshot" :: held 3.009s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Snapshots deleted, issuing volume delete {{(pid=94472) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-7f04c3f5-239a-405f-972e-f338c1e21096" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-7f04c3f5-239a-405f-972e-f338c1e21096" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af73935-f792-44d2-8385-d2df7f7bc0a1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:26 devstack sudo[112307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 Jun 24 00:33:26 devstack sudo[112307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:27 devstack sudo[112307]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096" returned: 0 in 0.719s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:27 devstack sudo[112312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096 Jun 24 00:33:27 devstack sudo[112312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:28 devstack sudo[112312]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7f04c3f5-239a-405f-972e-f338c1e21096" returned: 0 in 0.610s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-7f04c3f5-239a-405f-972e-f338c1e21096" released by "delete_volume" :: held 1.383s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Created reservations ['d3f53733-85cb-47e6-b833-fec35ddecd23', 'ba7315c3-ddca-4fc9-8c98-a1a2f747b683', '3c1a65e4-ff5a-465e-8ab5-d4b7aa77eb29', '716e2330-8491-4216-84d3-5a6c4a485559'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:28 devstack sudo[112315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:33:28 devstack sudo[112315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:28 devstack sudo[112315]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.600s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:33:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Deleted volume successfully. Jun 24 00:33:28 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-36219f5a-e63a-445b-ab80-f6bdefdf1aa3 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-7f04c3f5-239a-405f-972e-f338c1e21096-delete_volume" released by "delete_volume" :: held 5.189s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-f838667c-c3ef-46f1-99b8-c4696092e17a-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-f838667c-c3ef-46f1-99b8-c4696092e17a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "cinder-quobyte-f838667c-c3ef-46f1-99b8-c4696092e17a" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-f838667c-c3ef-46f1-99b8-c4696092e17a" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:29 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38dfd03-f661-46e2-a15e-963863adb2a6]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:33:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:29 devstack sudo[112318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a Jun 24 00:33:29 devstack sudo[112318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:30 devstack sudo[112318]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a" returned: 0 in 0.735s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:30 devstack sudo[112323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a Jun 24 00:33:30 devstack sudo[112323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:30 devstack sudo[112323]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-f838667c-c3ef-46f1-99b8-c4696092e17a" returned: 0 in 0.598s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-quobyte-f838667c-c3ef-46f1-99b8-c4696092e17a" released by "delete_volume" :: held 1.372s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Created reservations ['1e3912a8-a646-4e3d-8657-b2432fa8601c', '71f450d6-0cbc-41d9-9580-afa7c1f3d9ca', '78b50723-cb6e-4b02-af5c-5c9a452a5df8', '47439b21-989e-4006-8660-b8bfcfddcb29'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:30 devstack sudo[112326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:33:30 devstack sudo[112326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:31 devstack sudo[112326]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.616s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:31 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:33:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Deleted volume successfully. Jun 24 00:33:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6502043c-061b-4a82-b09b-c6ed371597c0 tempest-VolumesDeleteCascade-298846265 None] Lock "cinder-f838667c-c3ef-46f1-99b8-c4696092e17a-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:33:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:33:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:33:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:39 devstack sudo[112331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:33:39 devstack sudo[112331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:40 devstack sudo[112331]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.658s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:33:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:33:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:33:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:33:40 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=54,cinder:UPDATE=45,cinder:DELETE=3,cinder:INSERT=12 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:33:41 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=60,cinder:SELECT=40,cinder:INSERT=16,cinder:DELETE=6 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Flow 'volume_create_manager' (c2955693-9b65-4697-8425-25c01a1025eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a9b768-239e-4cfd-b5ae-83336e259b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a9b768-239e-4cfd-b5ae-83336e259b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-531985039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c782db2-f621-40b3-94d6-3b11d30f7709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe2bdf15aaa14acea8a7db8c96772b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:33:42Z,use_quota=True,user_id='81b8a2ebcc7841419c6a45b9249b0231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32379e8-2990-4e16-8126-ad9be46e35aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32379e8-2990-4e16-8126-ad9be46e35aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b043ffa8-2138-4836-a556-9ff8919c85ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b043ffa8-2138-4836-a556-9ff8919c85ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c782db2-f621-40b3-94d6-3b11d30f7709', 'volume_name': 'volume-9c782db2-f621-40b3-94d6-3b11d30f7709', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee46a4f7-a416-44c6-92af-4010194a76e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee46a4f7-a416-44c6-92af-4010194a76e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a43d7e1-ab98-4eff-a66a-347e95be1a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:42 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Volume 9c782db2-f621-40b3-94d6-3b11d30f7709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c782db2-f621-40b3-94d6-3b11d30f7709', 'volume_size': 1} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-531985039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c782db2-f621-40b3-94d6-3b11d30f7709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe2bdf15aaa14acea8a7db8c96772b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:33:42Z,use_quota=True,user_id='81b8a2ebcc7841419c6a45b9249b0231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Creating volume 9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:33:42 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:33:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:42 devstack sudo[112334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 1073741824 Jun 24 00:33:42 devstack sudo[112334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:43 devstack sudo[112334]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 1073741824" returned: 0 in 0.791s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:33:43 devstack sudo[112345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:33:43 devstack sudo[112345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:33:43 devstack sudo[112345]: pam_unix(sudo:session): session closed for user root Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.612s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a43d7e1-ab98-4eff-a66a-347e95be1a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c782db2-f621-40b3-94d6-3b11d30f7709', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0aa5db-09d5-40c3-9556-e8615c0e9ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:33:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Volume volume-9c782db2-f621-40b3-94d6-3b11d30f7709 (9c782db2-f621-40b3-94d6-3b11d30f7709): created successfully Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0aa5db-09d5-40c3-9556-e8615c0e9ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:33:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Flow 'volume_create_manager' (c2955693-9b65-4697-8425-25c01a1025eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:33:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7137f32a-e262-46d4-bdba-604e96163a9d tempest-VolumesActionsTest-1752411006 None] Created volume successfully. Jun 24 00:33:53 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:33:53 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:33:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-728d3787-38ee-4932-b021-99d302abdf34 tempest-VolumesActionsTest-1752411006 None] Acquiring lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709" by "attach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-728d3787-38ee-4932-b021-99d302abdf34 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709" acquired by "attach_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-728d3787-38ee-4932-b021-99d302abdf34 tempest-VolumesActionsTest-1752411006 None] Attaching volume 9c782db2-f621-40b3-94d6-3b11d30f7709 to instance 71456739-a6f6-4525-b456-15adea8dc4ac at mountpoint /dev/vdb on host None. Jun 24 00:33:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-728d3787-38ee-4932-b021-99d302abdf34 tempest-VolumesActionsTest-1752411006 None] Attach volume completed successfully. Jun 24 00:33:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-728d3787-38ee-4932-b021-99d302abdf34 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709" released by "attach_volume" :: held 0.082s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:33:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c30ffbc6-398f-4e3d-bbe4-28d0172dce9a tempest-VolumesActionsTest-1752411006 None] Acquiring lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-detach_volume" by "detach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:33:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c30ffbc6-398f-4e3d-bbe4-28d0172dce9a tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:33:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c30ffbc6-398f-4e3d-bbe4-28d0172dce9a tempest-VolumesActionsTest-1752411006 None] Detaching volume 9c782db2-f621-40b3-94d6-3b11d30f7709 from instance 71456739-a6f6-4525-b456-15adea8dc4ac. Jun 24 00:34:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c30ffbc6-398f-4e3d-bbe4-28d0172dce9a tempest-VolumesActionsTest-1752411006 None] Detach volume completed successfully. Jun 24 00:34:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c30ffbc6-398f-4e3d-bbe4-28d0172dce9a tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:34:10 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:34:10 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:INSERT=2,cinder:SELECT=7,cinder:UPDATE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:34:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-24cdeb42-21b9-40f9-84f1-b1ebe0fa5125 tempest-VolumesActionsTest-1752411006 None] Acquiring lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709" by "attach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:34:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-24cdeb42-21b9-40f9-84f1-b1ebe0fa5125 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709" acquired by "attach_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:34:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-24cdeb42-21b9-40f9-84f1-b1ebe0fa5125 tempest-VolumesActionsTest-1752411006 None] Attaching volume 9c782db2-f621-40b3-94d6-3b11d30f7709 to instance b1a94d79-8a3a-4562-910e-1eb0a20dce32 at mountpoint /dev/vdb on host None. Jun 24 00:34:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-24cdeb42-21b9-40f9-84f1-b1ebe0fa5125 tempest-VolumesActionsTest-1752411006 None] Attach volume completed successfully. Jun 24 00:34:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-24cdeb42-21b9-40f9-84f1-b1ebe0fa5125 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709" released by "attach_volume" :: held 0.088s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:34:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47beb808-b477-4a23-803a-36b94edf8bd0 tempest-VolumesActionsTest-1752411006 None] Acquiring lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-detach_volume" by "detach_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:34:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47beb808-b477-4a23-803a-36b94edf8bd0 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:34:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-47beb808-b477-4a23-803a-36b94edf8bd0 tempest-VolumesActionsTest-1752411006 None] Detaching volume 9c782db2-f621-40b3-94d6-3b11d30f7709 from instance b1a94d79-8a3a-4562-910e-1eb0a20dce32. Jun 24 00:34:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-47beb808-b477-4a23-803a-36b94edf8bd0 tempest-VolumesActionsTest-1752411006 None] Detach volume completed successfully. Jun 24 00:34:24 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-47beb808-b477-4a23-803a-36b94edf8bd0 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:34:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:34:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:34:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2951040d-3381-4d30-bd80-e49c163c3c12]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:34:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:34:33 devstack sudo[112746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:34:33 devstack sudo[112746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:34:34 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:34:34 devstack sudo[112746]: pam_unix(sudo:session): session closed for user root Jun 24 00:34:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.745s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:34:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b66e09a-11a8-4efb-9f56-1de96f2811e2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:34:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:34:34 devstack sudo[112751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:34:34 devstack sudo[112751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:34:35 devstack sudo[112751]: pam_unix(sudo:session): session closed for user root Jun 24 00:34:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.726s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:34:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.c27f2747-a0f9-43b8-859d-394b4b6fb056wu6mb17i.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:34:35 devstack sudo[112757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.c27f2747-a0f9-43b8-859d-394b4b6fb056wu6mb17i.img Jun 24 00:34:35 devstack sudo[112757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:34:39 devstack sudo[112757]: pam_unix(sudo:session): session closed for user root Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.c27f2747-a0f9-43b8-859d-394b4b6fb056wu6mb17i.img" returned: 0 in 4.297s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfeca5c-e6b1-4cba-9fa1-7938122e860f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:34:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:34:39 devstack sudo[112771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:34:39 devstack sudo[112771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:34:39 devstack sudo[112772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:34:39 devstack sudo[112772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:34:40 devstack sudo[112772]: pam_unix(sudo:session): session closed for user root Jun 24 00:34:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.662s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:34:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:34:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:34:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:34:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:34:40 devstack sudo[112771]: pam_unix(sudo:session): session closed for user root Jun 24 00:34:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.917s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:34:40 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.c27f2747-a0f9-43b8-859d-394b4b6fb056wu6mb17i.img {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:34:40 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Converted 1024.00 MB image at 238.25 MB/s Jun 24 00:34:40 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] c27f2747-a0f9-43b8-859d-394b4b6fb056 was raw, no need to convert to raw {{(pid=94472) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 24 00:34:43 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:34:50 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:34:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.833s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:34:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Uploaded volume to glance image-id: c27f2747-a0f9-43b8-859d-394b4b6fb056. {{(pid=94472) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 24 00:34:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c66e41a2-eec0-4f96-a210-e6fc809f7185 tempest-VolumesActionsTest-1752411006 None] Copy volume to image completed successfully. Jun 24 00:35:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed68a9c-7902-4da4-8c26-2820a2d55c7a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:00 devstack sudo[112787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:35:00 devstack sudo[112787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:01 devstack sudo[112787]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.794s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:01 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bd6460-dd9a-4595-8e04-0ee387e8bcff]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:01 devstack sudo[112796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:35:01 devstack sudo[112796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:02 devstack sudo[112796]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.745s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:02 devstack sudo[112801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img Jun 24 00:35:02 devstack sudo[112801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:06 devstack sudo[112801]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img" returned: 0 in 4.076s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:06 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c97f72b-6413-4ddf-86d3-9357ef09e79b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:06 devstack sudo[112814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:35:06 devstack sudo[112814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:07 devstack sudo[112814]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.871s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:07 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:35:07 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Converted 1024.00 MB image at 251.15 MB/s Jun 24 00:35:07 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] df4660ab-c9ea-402f-985d-7b9aa5e522b1 was raw, converting to qcow2 {{(pid=94472) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 24 00:35:07 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfdb128-72d7-40f4-86df-be0f0746430f]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:07 devstack sudo[112820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img Jun 24 00:35:07 devstack sudo[112820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:07 devstack sudo[112820]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img" returned: 0 in 0.716s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:07 devstack sudo[112824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img Jun 24 00:35:07 devstack sudo[112824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:08 devstack sudo[112824]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img" returned: 1 in 0.706s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:35:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img /opt/stack/data/cinder/conversion/vol_upload_2swpebw3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:08 devstack sudo[112829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img /opt/stack/data/cinder/conversion/vol_upload_2swpebw3 Jun 24 00:35:08 devstack sudo[112829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:09 devstack sudo[112829]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img /opt/stack/data/cinder/conversion/vol_upload_2swpebw3" returned: 0 in 0.612s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:09 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Image conversion details: src /opt/stack/data/cinder/conversion/9c782db2-f621-40b3-94d6-3b11d30f7709.temp_image.df4660ab-c9ea-402f-985d-7b9aa5e522b1882a1nxh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2swpebw3 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:35:09 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 24 00:35:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b6650-3f46-4914-8e0d-97ed481ecc0a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2swpebw3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:09 devstack sudo[112834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2swpebw3 Jun 24 00:35:09 devstack sudo[112834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:09 devstack sudo[112834]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2swpebw3" returned: 0 in 0.706s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.570s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Uploaded volume to glance image-id: df4660ab-c9ea-402f-985d-7b9aa5e522b1. {{(pid=94472) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 24 00:35:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ceccf9c4-48e4-4960-a50a-cfd1d1d4d7f3 tempest-VolumesActionsTest-1752411006 None] Copy volume to image completed successfully. Jun 24 00:35:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Acquiring lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:35:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:35:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Acquiring lock "cinder-quobyte-9c782db2-f621-40b3-94d6-3b11d30f7709" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:35:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-quobyte-9c782db2-f621-40b3-94d6-3b11d30f7709" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:35:12 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5132325-bbdd-48f3-8200-e961548dd7d1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:12 devstack sudo[112877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:35:12 devstack sudo[112877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:13 devstack sudo[112877]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.772s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:13 devstack sudo[112882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709 Jun 24 00:35:13 devstack sudo[112882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:14 devstack sudo[112882]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-9c782db2-f621-40b3-94d6-3b11d30f7709" returned: 0 in 0.704s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-quobyte-9c782db2-f621-40b3-94d6-3b11d30f7709" released by "delete_volume" :: held 1.517s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Created reservations ['50df855d-2c84-452c-9051-dca4a5d586af', '76ce32aa-613a-4473-8251-a6cab4303216', '2af26847-4665-489a-87e1-4567ef70e115', '490fd8e7-69e3-4c98-be88-a5244b10a787'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:14 devstack sudo[112885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:35:14 devstack sudo[112885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:14 devstack sudo[112885]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.668s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:35:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Deleted volume successfully. Jun 24 00:35:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-0e1934b5-79ed-4567-bb08-d6369b53fc79 tempest-VolumesActionsTest-1752411006 None] Lock "cinder-9c782db2-f621-40b3-94d6-3b11d30f7709-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Flow 'volume_create_manager' (d14a1cb3-4b09-486b-adbe-02309f77a666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3e8a89-861b-45c2-82de-c82bba0a1819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3e8a89-861b-45c2-82de-c82bba0a1819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1179366700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a058c113-c6df-49ab-8b65-4b0016b1c783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7757d26f35d8495a9c6084cff787038d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:35:20Z,use_quota=True,user_id='3e5d39f4689f444887dc9351c5d1b7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed32e8a-3251-44cb-a2a2-97130320b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed32e8a-3251-44cb-a2a2-97130320b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fafdf12-51ed-4d09-8844-b7e5d6a07042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fafdf12-51ed-4d09-8844-b7e5d6a07042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a058c113-c6df-49ab-8b65-4b0016b1c783', 'volume_name': 'volume-a058c113-c6df-49ab-8b65-4b0016b1c783', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f918b23b-604b-420c-832d-e6951a3fdc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f918b23b-604b-420c-832d-e6951a3fdc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3868e8-8d91-4fc7-9405-372ea153d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Volume a058c113-c6df-49ab-8b65-4b0016b1c783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a058c113-c6df-49ab-8b65-4b0016b1c783', 'volume_size': 1} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1179366700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a058c113-c6df-49ab-8b65-4b0016b1c783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7757d26f35d8495a9c6084cff787038d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:35:20Z,use_quota=True,user_id='3e5d39f4689f444887dc9351c5d1b7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Creating volume a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:35:20 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:35:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:20 devstack sudo[112896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 1073741824 Jun 24 00:35:20 devstack sudo[112896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:21 devstack sudo[112896]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 1073741824" returned: 0 in 0.877s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:21 devstack sudo[112902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 Jun 24 00:35:21 devstack sudo[112902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:22 devstack sudo[112902]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783" returned: 0 in 0.681s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3868e8-8d91-4fc7-9405-372ea153d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a058c113-c6df-49ab-8b65-4b0016b1c783', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6568119-dbf1-4ff9-bf58-5aaaa4a36610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Volume volume-a058c113-c6df-49ab-8b65-4b0016b1c783 (a058c113-c6df-49ab-8b65-4b0016b1c783): created successfully Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6568119-dbf1-4ff9-bf58-5aaaa4a36610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Flow 'volume_create_manager' (d14a1cb3-4b09-486b-adbe-02309f77a666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:35:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-020121e7-f413-4ff9-af1c-06c6f07a1088 tempest-VolumesCloneTest-646614985 None] Created volume successfully. Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Flow 'volume_create_manager' (a680b9d0-1c9a-444d-9c34-b711e4660c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed7ee91-d9b7-4783-823c-31105efe8547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed7ee91-d9b7-4783-823c-31105efe8547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1806254825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bd8999-e123-4400-86e8-f3170a73396e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7757d26f35d8495a9c6084cff787038d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:35:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a058c113-c6df-49ab-8b65-4b0016b1c783,status='creating',terminated_at=None,updated_at=2026-06-23T22:35:23Z,use_quota=True,user_id='3e5d39f4689f444887dc9351c5d1b7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9937c6-e65c-4840-b4fd-0001ec0721f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9937c6-e65c-4840-b4fd-0001ec0721f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c47d3e-e565-4f75-b141-e5fac8b4dcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c47d3e-e565-4f75-b141-e5fac8b4dcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '08bd8999-e123-4400-86e8-f3170a73396e', 'volume_name': 'volume-08bd8999-e123-4400-86e8-f3170a73396e', 'volume_size': 2, 'source_volid': 'a058c113-c6df-49ab-8b65-4b0016b1c783', 'source_volstatus': 'available'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c0989-1fbe-4aa3-ad28-a6f38ab9f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c0989-1fbe-4aa3-ad28-a6f38ab9f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1132148-a6de-4a68-a33b-a522b51af43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Volume 08bd8999-e123-4400-86e8-f3170a73396e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-08bd8999-e123-4400-86e8-f3170a73396e', 'volume_size': 2, 'source_volid': 'a058c113-c6df-49ab-8b65-4b0016b1c783', 'source_volstatus': 'available'} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:22 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Cloning volume a058c113-c6df-49ab-8b65-4b0016b1c783 to volume 08bd8999-e123-4400-86e8-f3170a73396e Jun 24 00:35:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Creating offline snapshot 5baf754f-10e9-4fbe-baab-0f573159251d of volume a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:35:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e145f-6096-4319-8397-c8caf86653de]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:23 devstack sudo[112905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 Jun 24 00:35:23 devstack sudo[112905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:23 devstack sudo[112905]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783" returned: 0 in 0.787s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:23 devstack sudo[112910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d 1G Jun 24 00:35:23 devstack sudo[112910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:24 devstack sudo[112910]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d 1G" returned: 0 in 0.772s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a058c113-c6df-49ab-8b65-4b0016b1c783 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:24 devstack sudo[112915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a058c113-c6df-49ab-8b65-4b0016b1c783 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d Jun 24 00:35:24 devstack sudo[112915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:25 devstack sudo[112915]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a058c113-c6df-49ab-8b65-4b0016b1c783 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d" returned: 0 in 0.665s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:25 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d is being set with open permissions: ugo+rw Jun 24 00:35:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:25 devstack sudo[112920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d Jun 24 00:35:25 devstack sudo[112920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:25 devstack sudo[112920]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d" returned: 0 in 0.621s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:25 devstack sudo[112923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.info Jun 24 00:35:25 devstack sudo[112923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:26 devstack sudo[112923]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.info" returned: 0 in 0.632s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:26 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.info is being set with open permissions: ugo+rw Jun 24 00:35:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:26 devstack sudo[112927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.info Jun 24 00:35:26 devstack sudo[112927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:27 devstack sudo[112927]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.info" returned: 0 in 0.609s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Acquiring lock "cinder-quobyte-08bd8999-e123-4400-86e8-f3170a73396e" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Lock "cinder-quobyte-08bd8999-e123-4400-86e8-f3170a73396e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] snapshot: 5baf754f-10e9-4fbe-baab-0f573159251d, volume: 08bd8999-e123-4400-86e8-f3170a73396e, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3b5c3-dc68-47f3-be20-04eda92c3842]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:27 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d Jun 24 00:35:27 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:27 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d" returned: 0 in 0.727s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a058c113-c6df-49ab-8b65-4b0016b1c783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e8d2f4-7558-4661-9c1d-bba87230b0ab]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:28 devstack sudo[112935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 Jun 24 00:35:28 devstack sudo[112935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:28 devstack sudo[112935]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783" returned: 0 in 0.743s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:28 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:35:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:28 devstack sudo[112940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e Jun 24 00:35:28 devstack sudo[112940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:33 devstack sudo[112940]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e" returned: 0 in 4.421s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f8ad3-80dc-4885-bc08-6fae60268860]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:33 devstack sudo[112953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 Jun 24 00:35:33 devstack sudo[112953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:34 devstack sudo[112953]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783" returned: 0 in 0.923s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:35:34 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Converted 1024.00 MB image at 231.58 MB/s Jun 24 00:35:34 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e is being set with open permissions: ugo+rw Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:34 devstack sudo[112958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e Jun 24 00:35:34 devstack sudo[112958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:34 devstack sudo[112958]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e" returned: 0 in 0.636s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Lock "cinder-quobyte-08bd8999-e123-4400-86e8-f3170a73396e" released by "_copy_volume_from_snapshot" :: held 7.521s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Acquiring lock "cinder-quobyte-5baf754f-10e9-4fbe-baab-0f573159251d" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Lock "cinder-quobyte-5baf754f-10e9-4fbe-baab-0f573159251d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Deleting offline snapshot 5baf754f-10e9-4fbe-baab-0f573159251d of volume a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] snapshot_file for this snap is: volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee6b6d3-4f76-4232-8ec9-03cdfae0f0cc]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:34 devstack sudo[112961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d Jun 24 00:35:34 devstack sudo[112961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:35 devstack sudo[112961]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d" returned: 0 in 0.736s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a058c113-c6df-49ab-8b65-4b0016b1c783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:35:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[949d6f5f-352a-43b7-a5e7-5eb7ed57b255]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:35 devstack sudo[112966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 Jun 24 00:35:35 devstack sudo[112966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:35 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:35:36 devstack sudo[112966]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783" returned: 0 in 0.775s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:36 devstack sudo[112972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d Jun 24 00:35:36 devstack sudo[112972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:37 devstack sudo[112972]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d" returned: 0 in 0.751s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:37 devstack sudo[112977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d Jun 24 00:35:37 devstack sudo[112977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:37 devstack sudo[112977]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783.5baf754f-10e9-4fbe-baab-0f573159251d" returned: 0 in 0.617s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Lock "cinder-quobyte-5baf754f-10e9-4fbe-baab-0f573159251d" released by "_delete_snapshot" :: held 2.970s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.757s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1132148-a6de-4a68-a33b-a522b51af43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bd8999-e123-4400-86e8-f3170a73396e', 'volume_size': 2, 'source_volid': 'a058c113-c6df-49ab-8b65-4b0016b1c783', 'source_volstatus': 'available'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61032bf-5f9a-4d42-8e69-136427fc028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:35:37 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Volume volume-08bd8999-e123-4400-86e8-f3170a73396e (08bd8999-e123-4400-86e8-f3170a73396e): created successfully Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61032bf-5f9a-4d42-8e69-136427fc028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:35:37 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Flow 'volume_create_manager' (a680b9d0-1c9a-444d-9c34-b711e4660c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:35:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-449f05ad-2179-4aea-ab57-660a29a158fa tempest-VolumesCloneTest-646614985 None] Created volume successfully. Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Acquiring lock "cinder-08bd8999-e123-4400-86e8-f3170a73396e-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Lock "cinder-08bd8999-e123-4400-86e8-f3170a73396e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Acquiring lock "cinder-quobyte-08bd8999-e123-4400-86e8-f3170a73396e" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Lock "cinder-quobyte-08bd8999-e123-4400-86e8-f3170a73396e" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3eea0e-f485-4d34-bfba-f7f0725033b5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:39 devstack sudo[112980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e Jun 24 00:35:39 devstack sudo[112980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:39 devstack sudo[112982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:35:39 devstack sudo[112982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:40 devstack sudo[112980]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e" returned: 0 in 0.866s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:40 devstack sudo[112987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e Jun 24 00:35:40 devstack sudo[112987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:40 devstack sudo[112982]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.756s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:35:40 devstack sudo[112987]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-08bd8999-e123-4400-86e8-f3170a73396e" returned: 0 in 0.648s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Lock "cinder-quobyte-08bd8999-e123-4400-86e8-f3170a73396e" released by "delete_volume" :: held 1.554s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Created reservations ['d325d86f-dc41-4a97-b523-8de4a12db344', 'e4763a54-cde6-476b-ae80-01b92b563289', '7a152527-8abe-4c02-84e6-fe85750e5a96', '7c9ee732-0d51-45fe-81f5-c5ba280bfc7d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:40 devstack sudo[112991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:35:40 devstack sudo[112991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Acquiring lock "cinder-a058c113-c6df-49ab-8b65-4b0016b1c783-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Lock "cinder-a058c113-c6df-49ab-8b65-4b0016b1c783-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Acquiring lock "cinder-quobyte-a058c113-c6df-49ab-8b65-4b0016b1c783" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Lock "cinder-quobyte-a058c113-c6df-49ab-8b65-4b0016b1c783" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[34479b54-c9b3-4a49-b965-9f92f493c5cf]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:41 devstack sudo[112994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 Jun 24 00:35:41 devstack sudo[112994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:41 devstack sudo[112991]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.785s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:35:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Deleted volume successfully. Jun 24 00:35:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-1eb1171d-06ce-4f61-a923-2c6e34580da4 tempest-VolumesCloneTest-646614985 None] Lock "cinder-08bd8999-e123-4400-86e8-f3170a73396e-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:35:42 devstack sudo[112994]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783" returned: 0 in 0.819s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:42 devstack sudo[112999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783 Jun 24 00:35:42 devstack sudo[112999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:42 devstack sudo[112999]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-a058c113-c6df-49ab-8b65-4b0016b1c783" returned: 0 in 0.636s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Lock "cinder-quobyte-a058c113-c6df-49ab-8b65-4b0016b1c783" released by "delete_volume" :: held 1.521s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Created reservations ['a59f2514-d36e-43b6-a88b-e23eb83cbf99', '10af0bf0-b0a9-40e2-8f4a-d49cf4dda4d8', '77d2e169-7ab2-41d6-b8e3-d96f637dc94a', '25251158-b13f-4d16-882e-49ab78ad4f7e'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:35:43 devstack sudo[113008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:35:43 devstack sudo[113008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:35:43 devstack sudo[113008]: pam_unix(sudo:session): session closed for user root Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.616s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:35:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Deleted volume successfully. Jun 24 00:35:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ef924d6c-dfb9-4823-8437-41dd02f53387 tempest-VolumesCloneTest-646614985 None] Lock "cinder-a058c113-c6df-49ab-8b65-4b0016b1c783-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:35:53 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=20,cinder:SELECT=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:35:53 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=22,cinder:UPDATE=35,cinder:INSERT=6,cinder:DELETE=3 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Flow 'volume_create_manager' (71b4b3c2-184c-4a3b-a736-f6c3c1185691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da22b3c3-1b76-4a91-9a72-89db8307dfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da22b3c3-1b76-4a91-9a72-89db8307dfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-732457959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f56945-ad8f-4bfe-b2d7-994d32930fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86203457705d4892af433875a8df6e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:36:09Z,use_quota=True,user_id='d053a103b1044eac81f86404dcac6e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e893e42f-d9ca-47da-a74b-f46553cc16e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e893e42f-d9ca-47da-a74b-f46553cc16e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daee1dc-0f67-4052-98ab-3a77ac490e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daee1dc-0f67-4052-98ab-3a77ac490e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f56945-ad8f-4bfe-b2d7-994d32930fc9', 'volume_name': 'volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99edabde-2c61-4843-80a2-b41aea8f1ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99edabde-2c61-4843-80a2-b41aea8f1ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1188b9be-e5b2-4f99-9e83-b3908a7cdac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:36:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Volume 69f56945-ad8f-4bfe-b2d7-994d32930fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9', 'volume_size': 1} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-732457959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f56945-ad8f-4bfe-b2d7-994d32930fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86203457705d4892af433875a8df6e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:36:09Z,use_quota=True,user_id='d053a103b1044eac81f86404dcac6e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Creating volume 69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:36:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:36:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:36:09 devstack sudo[113015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 1073741824 Jun 24 00:36:09 devstack sudo[113015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:36:10 devstack sudo[113015]: pam_unix(sudo:session): session closed for user root Jun 24 00:36:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 1073741824" returned: 0 in 0.926s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:36:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:36:10 devstack sudo[113025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 Jun 24 00:36:10 devstack sudo[113025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:36:11 devstack sudo[113025]: pam_unix(sudo:session): session closed for user root Jun 24 00:36:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9" returned: 0 in 0.645s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:36:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:36:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:36:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1188b9be-e5b2-4f99-9e83-b3908a7cdac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:36:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ea9a46-cb4b-40fd-9f1c-0ed5b5cd47fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:36:11 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Volume volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 (69f56945-ad8f-4bfe-b2d7-994d32930fc9): created successfully Jun 24 00:36:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ea9a46-cb4b-40fd-9f1c-0ed5b5cd47fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:36:11 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Flow 'volume_create_manager' (71b4b3c2-184c-4a3b-a736-f6c3c1185691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:36:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-99b36b25-205f-4508-b41d-c5ca61281bea tempest-TestStampPattern-72041313 None] Created volume successfully. Jun 24 00:36:21 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:36:21 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:36:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:36:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:36:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:36:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:36:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:36:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:36:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:36:39 devstack sudo[113188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:36:39 devstack sudo[113188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:36:40 devstack sudo[113188]: pam_unix(sudo:session): session closed for user root Jun 24 00:36:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.619s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:36:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:36:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:36:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:36:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:36:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ac883d1d-8360-41b8-8af8-e46ff195362a req-459e2135-c35a-439a-a4f3-18d789692445 tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:36:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ac883d1d-8360-41b8-8af8-e46ff195362a req-459e2135-c35a-439a-a4f3-18d789692445 tempest-TestStampPattern-72041313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:36:51 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b389457-247b-4378-a90a-de045074d91c]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:36:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ac883d1d-8360-41b8-8af8-e46ff195362a req-459e2135-c35a-439a-a4f3-18d789692445 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:36:51 devstack sudo[113213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 Jun 24 00:36:51 devstack sudo[113213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:36:52 devstack sudo[113213]: pam_unix(sudo:session): session closed for user root Jun 24 00:36:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-ac883d1d-8360-41b8-8af8-e46ff195362a req-459e2135-c35a-439a-a4f3-18d789692445 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9" returned: 0 in 0.743s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:36:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-ac883d1d-8360-41b8-8af8-e46ff195362a req-459e2135-c35a-439a-a4f3-18d789692445 tempest-TestStampPattern-72041313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.760s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:36:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-ac883d1d-8360-41b8-8af8-e46ff195362a req-459e2135-c35a-439a-a4f3-18d789692445 tempest-TestStampPattern-72041313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c03eabab-d322-45c3-bfb7-0462eea8ba2e', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:36:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-ac883d1d-8360-41b8-8af8-e46ff195362a req-459e2135-c35a-439a-a4f3-18d789692445 tempest-TestStampPattern-72041313 None] attachment_update completed successfully. Jun 24 00:37:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-47a704ad-1495-4036-84e6-e981207c736f req-43be988d-2614-4842-ae13-b51e6d22934b tempest-TestStampPattern-72041313 None] Terminate volume connection completed successfully. Jun 24 00:37:00 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-47a704ad-1495-4036-84e6-e981207c736f req-43be988d-2614-4842-ae13-b51e6d22934b tempest-TestStampPattern-72041313 None] Deleting attachment c03eabab-d322-45c3-bfb7-0462eea8ba2e. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:37:02 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:37:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:37:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:37:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Creating offline snapshot 604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 of volume 69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:37:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[14898eec-8a58-49f2-b90d-49eccc938878]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:37:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:02 devstack sudo[113656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 Jun 24 00:37:02 devstack sudo[113656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:03 devstack sudo[113656]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9" returned: 0 in 0.800s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:03 devstack sudo[113661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 1G Jun 24 00:37:03 devstack sudo[113661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:03 devstack sudo[113661]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 1G" returned: 0 in 0.862s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:03 devstack sudo[113666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 Jun 24 00:37:03 devstack sudo[113666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:04 devstack sudo[113666]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" returned: 0 in 0.691s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:04 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 is being set with open permissions: ugo+rw Jun 24 00:37:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:04 devstack sudo[113671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 Jun 24 00:37:04 devstack sudo[113671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:05 devstack sudo[113671]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" returned: 0 in 0.635s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:05 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.info Jun 24 00:37:05 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:05 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.info" returned: 0 in 0.666s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:05 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.info is being set with open permissions: ugo+rw Jun 24 00:37:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:06 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.info Jun 24 00:37:06 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:06 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.info" returned: 0 in 0.641s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.391s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:37:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-33776ae4-4e33-4444-b860-7d70ff8f76bb tempest-TestStampPattern-72041313 None] Create snapshot completed successfully Jun 24 00:37:16 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:37:16 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Flow 'volume_create_manager' (706adf5e-e658-48f1-89ad-5efc20445f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1110fcbf-884f-4f7f-ad56-2878f9f19d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1110fcbf-884f-4f7f-ad56-2878f9f19d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-78606873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168973e2-88ea-483c-b012-4ab74c84ba8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86203457705d4892af433875a8df6e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:37:17Z,use_quota=True,user_id='d053a103b1044eac81f86404dcac6e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45904b62-93e5-4010-8621-52b5906f81b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45904b62-93e5-4010-8621-52b5906f81b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0521deed-0b0c-41d6-8825-4cfbbf95a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0521deed-0b0c-41d6-8825-4cfbbf95a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '168973e2-88ea-483c-b012-4ab74c84ba8f', 'volume_name': 'volume-168973e2-88ea-483c-b012-4ab74c84ba8f', 'volume_size': 1, 'snapshot_id': '604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e4433b-8862-4b91-9c06-8264775141d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e4433b-8862-4b91-9c06-8264775141d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d24517-6d34-4327-b725-e98ef3900fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:37:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Volume 168973e2-88ea-483c-b012-4ab74c84ba8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-168973e2-88ea-483c-b012-4ab74c84ba8f', 'volume_size': 1, 'snapshot_id': '604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1'} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-quobyte-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1-168973e2-88ea-483c-b012-4ab74c84ba8f" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1-168973e2-88ea-483c-b012-4ab74c84ba8f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Creating volume 168973e2-88ea-483c-b012-4ab74c84ba8f from snapshot 604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-quobyte-168973e2-88ea-483c-b012-4ab74c84ba8f" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-168973e2-88ea-483c-b012-4ab74c84ba8f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] snapshot: 604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1, volume: 168973e2-88ea-483c-b012-4ab74c84ba8f, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a33e2d-9816-43ea-a533-ceef0397975d]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:37:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:17 devstack sudo[113763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 Jun 24 00:37:17 devstack sudo[113763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:18 devstack sudo[113763]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" returned: 0 in 0.810s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:37:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:37:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:37:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbcb348-9e67-4824-834e-d8f20eb3df50]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:37:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:18 devstack sudo[113774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 Jun 24 00:37:18 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:19 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9" returned: 0 in 0.831s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:19 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:37:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:19 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f Jun 24 00:37:19 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:24 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f" returned: 0 in 5.088s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba0973b-d031-458b-897d-b8631d8af233]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:37:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:24 devstack sudo[113794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 Jun 24 00:37:24 devstack sudo[113794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:25 devstack sudo[113794]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9" returned: 0 in 1.100s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:25 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:37:25 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Converted 1024.00 MB image at 201.21 MB/s Jun 24 00:37:25 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f is being set with open permissions: ugo+rw Jun 24 00:37:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:25 devstack sudo[113800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f Jun 24 00:37:25 devstack sudo[113800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:26 devstack sudo[113800]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f" returned: 0 in 0.803s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-168973e2-88ea-483c-b012-4ab74c84ba8f" released by "_copy_volume_from_snapshot" :: held 8.760s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:37:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1-168973e2-88ea-483c-b012-4ab74c84ba8f" released by "_create_volume_from_snapshot" :: held 8.789s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:37:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.807s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:37:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d24517-6d34-4327-b725-e98ef3900fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168973e2-88ea-483c-b012-4ab74c84ba8f', 'volume_size': 1, 'snapshot_id': '604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:37:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762a3232-cedb-4919-bf6b-ed31fa35b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:37:26 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Volume volume-168973e2-88ea-483c-b012-4ab74c84ba8f (168973e2-88ea-483c-b012-4ab74c84ba8f): created successfully Jun 24 00:37:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762a3232-cedb-4919-bf6b-ed31fa35b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:37:26 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Flow 'volume_create_manager' (706adf5e-e658-48f1-89ad-5efc20445f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:37:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e7346159-e5e6-4b88-85ec-38c3c565b441 tempest-TestStampPattern-72041313 None] Created volume successfully. Jun 24 00:37:36 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:37:36 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:37:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:37:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:37:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:37:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:37:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:37:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:37:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:37:39 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:37:39 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:37:40 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Jun 24 00:37:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.663s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:37:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:37:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:37:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:37:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:38:09 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:38:09 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-2718d1fc-d7e8-4f7f-9539-9e1470b1e49b req-63deb493-38fb-4958-a1c0-a1d3b52b8223 tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-2718d1fc-d7e8-4f7f-9539-9e1470b1e49b req-63deb493-38fb-4958-a1c0-a1d3b52b8223 tempest-TestStampPattern-72041313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:38:14 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3421f921-25e0-4e3c-be71-ecee814faf1f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:38:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-2718d1fc-d7e8-4f7f-9539-9e1470b1e49b req-63deb493-38fb-4958-a1c0-a1d3b52b8223 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:14 devstack sudo[113976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f Jun 24 00:38:14 devstack sudo[113976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:15 devstack sudo[113976]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [req-2718d1fc-d7e8-4f7f-9539-9e1470b1e49b req-63deb493-38fb-4958-a1c0-a1d3b52b8223 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f" returned: 0 in 0.850s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [req-2718d1fc-d7e8-4f7f-9539-9e1470b1e49b req-63deb493-38fb-4958-a1c0-a1d3b52b8223 tempest-TestStampPattern-72041313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.867s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:38:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-2718d1fc-d7e8-4f7f-9539-9e1470b1e49b req-63deb493-38fb-4958-a1c0-a1d3b52b8223 tempest-TestStampPattern-72041313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01', 'name': 'volume-168973e2-88ea-483c-b012-4ab74c84ba8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0da8ff3f-83d7-49b6-8ec0-9b7bd5fac998', 'enforce_multipath': True} {{(pid=94472) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 00:38:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-2718d1fc-d7e8-4f7f-9539-9e1470b1e49b req-63deb493-38fb-4958-a1c0-a1d3b52b8223 tempest-TestStampPattern-72041313 None] attachment_update completed successfully. Jun 24 00:38:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [req-86da115c-87dc-4bc1-84c2-b5803e3046ae req-ac8086cf-3a91-4749-9fe9-d88872379980 tempest-TestStampPattern-72041313 None] Terminate volume connection completed successfully. Jun 24 00:38:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [req-86da115c-87dc-4bc1-84c2-b5803e3046ae req-ac8086cf-3a91-4749-9fe9-d88872379980 tempest-TestStampPattern-72041313 None] Deleting attachment 0da8ff3f-83d7-49b6-8ec0-9b7bd5fac998. {{(pid=94472) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 00:38:25 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=6 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:38:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-168973e2-88ea-483c-b012-4ab74c84ba8f-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:38:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Lock "cinder-168973e2-88ea-483c-b012-4ab74c84ba8f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:38:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-quobyte-168973e2-88ea-483c-b012-4ab74c84ba8f" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:38:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-168973e2-88ea-483c-b012-4ab74c84ba8f" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:38:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab77a1c-7490-410b-b9ae-13677e8effa0]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:38:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:31 devstack sudo[114464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f Jun 24 00:38:31 devstack sudo[114464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:31 devstack sudo[114464]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f" returned: 0 in 0.797s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:32 devstack sudo[114469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f Jun 24 00:38:32 devstack sudo[114469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:32 devstack sudo[114469]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-168973e2-88ea-483c-b012-4ab74c84ba8f" returned: 0 in 0.666s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-168973e2-88ea-483c-b012-4ab74c84ba8f" released by "delete_volume" :: held 1.506s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Created reservations ['e6c8890e-094c-493a-9ca2-13afd14a7a3f', '9163bb02-e8f6-4703-a3ad-09a1f012942a', '7ed5fe28-c514-43c3-8899-98ffb2b8fb6b', 'eb299333-3bcf-4f32-bbd8-5fdc12a1bdc9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:38:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:32 devstack sudo[114472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:38:32 devstack sudo[114472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:33 devstack sudo[114472]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.640s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:38:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Deleted volume successfully. Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-981a1039-c9ce-413b-9e13-a83aff00c9a1 tempest-TestStampPattern-72041313 None] Lock "cinder-168973e2-88ea-483c-b012-4ab74c84ba8f-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Lock "cinder-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-quobyte-69f56945-ad8f-4bfe-b2d7-994d32930fc9" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-69f56945-ad8f-4bfe-b2d7-994d32930fc9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-quobyte-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Deleting offline snapshot 604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 of volume 69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] snapshot_file for this snap is: volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9966db-707e-4252-868e-2a9691f81a50]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:38:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:33 devstack sudo[114475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 Jun 24 00:38:33 devstack sudo[114475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:34 devstack sudo[114475]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" returned: 0 in 0.745s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:38:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[71534d57-1dc5-4b2f-a20f-0e2af9a8f704]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:38:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:34 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 Jun 24 00:38:34 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:35 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9" returned: 0 in 0.760s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:35 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 Jun 24 00:38:35 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:35 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" returned: 0 in 0.676s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:35 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1 Jun 24 00:38:35 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:36 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9.604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" returned: 0 in 0.616s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1" released by "_delete_snapshot" :: held 2.885s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:38:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-69f56945-ad8f-4bfe-b2d7-994d32930fc9" released by "delete_snapshot" :: held 2.908s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:38:36 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Created reservations ['caf5d16f-3994-4aa9-b07b-1cc153052d0f', 'd3fabc21-41bf-4936-9b96-a905e2e50048', 'fa7d8588-3a40-4a3e-9ceb-3d2150a1ad56', 'd3ad95dc-86fd-49fb-a824-839c44e5d3d9'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:38:36 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Delete snapshot completed successfully. Jun 24 00:38:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a9843d35-3127-43b3-87a0-bb021089c114 tempest-TestStampPattern-72041313 None] Lock "cinder-604abaa1-e8f2-4d77-90a7-5d0fd05d5ee1-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:38:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:38:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:38:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:38:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:38:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:38:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:38:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:39 devstack sudo[114541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:38:39 devstack sudo[114541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:40 devstack sudo[114541]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.686s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:38:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:38:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:38:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:38:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-69f56945-ad8f-4bfe-b2d7-994d32930fc9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:38:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Lock "cinder-69f56945-ad8f-4bfe-b2d7-994d32930fc9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:38:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Acquiring lock "cinder-quobyte-69f56945-ad8f-4bfe-b2d7-994d32930fc9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:38:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-69f56945-ad8f-4bfe-b2d7-994d32930fc9" acquired by "delete_volume" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:38:44 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdae382-fbdd-495c-9e4d-e90d685994d6]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:38:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:44 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 Jun 24 00:38:44 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:44 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9" returned: 0 in 0.797s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:44 devstack sudo[114557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9 Jun 24 00:38:44 devstack sudo[114557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:45 devstack sudo[114557]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69f56945-ad8f-4bfe-b2d7-994d32930fc9" returned: 0 in 0.631s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Lock "cinder-quobyte-69f56945-ad8f-4bfe-b2d7-994d32930fc9" released by "delete_volume" :: held 1.489s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Created reservations ['b402cf52-b370-4f93-9f8e-3be8edc84c2b', '318a993e-bdea-407e-8ec9-a533f2d1dd57', '1359f9b3-8189-4328-a99a-dc2f57fe81e1', 'ce64e0d3-7525-449e-9052-caf62124164f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:38:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:45 devstack sudo[114560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:38:45 devstack sudo[114560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:46 devstack sudo[114560]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.658s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:46 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:38:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Deleted volume successfully. Jun 24 00:38:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-81fdcb12-325c-4d0f-9bf4-cc3eac2b0b07 tempest-TestStampPattern-72041313 None] Lock "cinder-69f56945-ad8f-4bfe-b2d7-994d32930fc9-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:38:55 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=18,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=26,cinder:SELECT=16,cinder:INSERT=6,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (98aa0002-3717-49dc-bab1-6c655f80495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb71957-27ac-4f96-a5f6-6e2afb7866fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb71957-27ac-4f96-a5f6-6e2afb7866fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959888264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4b723c-75f1-440b-b092-75a96814dfc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:38:56Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffb3968-6403-4c98-8058-a9ff0954eb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffb3968-6403-4c98-8058-a9ff0954eb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf879f2-dcae-4944-a903-98a817dd38ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf879f2-dcae-4944-a903-98a817dd38ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4b723c-75f1-440b-b092-75a96814dfc5', 'volume_name': 'volume-aa4b723c-75f1-440b-b092-75a96814dfc5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d0b14e-1204-4df9-90a4-4a3df540ed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d0b14e-1204-4df9-90a4-4a3df540ed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da71382-797b-4236-a5b1-e9bd0418fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:38:56 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume aa4b723c-75f1-440b-b092-75a96814dfc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4b723c-75f1-440b-b092-75a96814dfc5', 'volume_size': 1} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959888264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4b723c-75f1-440b-b092-75a96814dfc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:38:56Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Creating volume aa4b723c-75f1-440b-b092-75a96814dfc5 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:38:56 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:38:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:56 devstack sudo[114569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 1073741824 Jun 24 00:38:56 devstack sudo[114569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:57 devstack sudo[114569]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 1073741824" returned: 0 in 0.794s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:57 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 Jun 24 00:38:57 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:57 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5" returned: 0 in 0.606s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da71382-797b-4236-a5b1-e9bd0418fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4b723c-75f1-440b-b092-75a96814dfc5', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfd6218-1ac9-454e-a55c-b28cb85d279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:38:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume volume-aa4b723c-75f1-440b-b092-75a96814dfc5 (aa4b723c-75f1-440b-b092-75a96814dfc5): created successfully Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfd6218-1ac9-454e-a55c-b28cb85d279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:38:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (98aa0002-3717-49dc-bab1-6c655f80495a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:38:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b49d3031-bf21-4035-bb65-33bc1994190b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created volume successfully. Jun 24 00:38:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:38:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:38:58 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Creating offline snapshot abff72aa-9dd7-47e5-b1be-6b2fa66873d8 of volume aa4b723c-75f1-440b-b092-75a96814dfc5 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:38:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a749aa-56de-4f02-bff3-6f5a0d62d1bd]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:38:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:58 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 Jun 24 00:38:58 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:38:59 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Jun 24 00:38:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5" returned: 0 in 0.711s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:38:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:38:59 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 1G Jun 24 00:38:59 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:00 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 1G" returned: 0 in 0.738s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b723c-75f1-440b-b092-75a96814dfc5 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:00 devstack sudo[114587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b723c-75f1-440b-b092-75a96814dfc5 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 Jun 24 00:39:00 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:00 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b723c-75f1-440b-b092-75a96814dfc5 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8" returned: 0 in 0.646s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:00 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 is being set with open permissions: ugo+rw Jun 24 00:39:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:00 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 Jun 24 00:39:00 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:01 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8" returned: 0 in 0.599s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:01 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.info Jun 24 00:39:01 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:01 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.info" returned: 0 in 0.640s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:01 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.info is being set with open permissions: ugo+rw Jun 24 00:39:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:01 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.info Jun 24 00:39:01 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:02 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.info" returned: 0 in 0.630s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.045s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-95dfac43-c88d-47c0-bdea-e92cf4ef2b4a tempest-CreateVolumesFromSnapshotTest-1428768152 None] Create snapshot completed successfully Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (4231f7d9-2a77-4c54-8031-084137aa851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a04bcc-5818-48a3-9c0c-54194c7f06eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a04bcc-5818-48a3-9c0c-54194c7f06eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723775325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed514d0f-284a-4681-850f-7c914c5105dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:03Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c009a6-380a-4f56-8ba8-361530191da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c009a6-380a-4f56-8ba8-361530191da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631f12af-84ee-48a7-b929-7d3413498f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631f12af-84ee-48a7-b929-7d3413498f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed514d0f-284a-4681-850f-7c914c5105dd', 'volume_name': 'volume-ed514d0f-284a-4681-850f-7c914c5105dd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92eaf21f-522c-4862-a405-e70f5bae6c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92eaf21f-522c-4862-a405-e70f5bae6c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590b289b-7363-4a01-89f4-6bb6c40171ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume ed514d0f-284a-4681-850f-7c914c5105dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed514d0f-284a-4681-850f-7c914c5105dd', 'volume_size': 1} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723775325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed514d0f-284a-4681-850f-7c914c5105dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:03Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Creating volume ed514d0f-284a-4681-850f-7c914c5105dd {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:39:03 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:03 devstack sudo[114602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd 1073741824 Jun 24 00:39:03 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (8ab220a7-9ea1-4b1d-a321-59c820d11492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e498b4b-d708-490e-9522-25cb1dcbe525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e498b4b-d708-490e-9522-25cb1dcbe525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217017064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d946e7-4b51-4c86-a521-2e0569acec46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:04Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17779f18-bcdc-4406-8352-44e7fa53ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17779f18-bcdc-4406-8352-44e7fa53ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c16343-578f-4863-9384-8cd3404c6c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c16343-578f-4863-9384-8cd3404c6c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d946e7-4b51-4c86-a521-2e0569acec46', 'volume_name': 'volume-69d946e7-4b51-4c86-a521-2e0569acec46', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5813b4-6bf3-4c39-9f0c-eef9ab2f6cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5813b4-6bf3-4c39-9f0c-eef9ab2f6cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc53182-1637-4125-9ed5-78dd0da1969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume 69d946e7-4b51-4c86-a521-2e0569acec46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d946e7-4b51-4c86-a521-2e0569acec46', 'volume_size': 1} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (44a6247f-3d3f-41b6-a9b8-b649b53be66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3962699-c28d-441f-a0c9-96d42e28e0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3962699-c28d-441f-a0c9-96d42e28e0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-983255091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10414e3-e19c-417c-9e72-ed3a20295470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:04Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d286709d-5e85-45a2-8fd2-e65f6a62dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d286709d-5e85-45a2-8fd2-e65f6a62dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90719f7c-815b-4a30-9634-d9695c703a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90719f7c-815b-4a30-9634-d9695c703a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10414e3-e19c-417c-9e72-ed3a20295470', 'volume_name': 'volume-e10414e3-e19c-417c-9e72-ed3a20295470', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab147a4-efe4-4ce2-b5a9-5b51fe799a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab147a4-efe4-4ce2-b5a9-5b51fe799a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef4222d-da14-4e96-9958-5e804af5df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume e10414e3-e19c-417c-9e72-ed3a20295470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10414e3-e19c-417c-9e72-ed3a20295470', 'volume_size': 1} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:04 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd 1073741824" returned: 0 in 0.963s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (9c5ac909-51d2-43c6-8276-cd6d2533b1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def9b57e-4278-4ddb-b9ec-951c6f33dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def9b57e-4278-4ddb-b9ec-951c6f33dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1241693248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:04Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48ecc30-f6e2-4d7d-bc29-8e99286d8b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd Jun 24 00:39:04 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48ecc30-f6e2-4d7d-bc29-8e99286d8b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95838d9e-fe0a-4d36-af52-3adf45901a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95838d9e-fe0a-4d36-af52-3adf45901a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4', 'volume_name': 'volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4335c89-51b1-4e2e-bf92-318f4ed14f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4335c89-51b1-4e2e-bf92-318f4ed14f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e7a677-2c3f-4f02-abea-1c89f6bbdeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4', 'volume_size': 1} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (c38e52b7-f416-4e08-aec6-07772d84feb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f309316f-98ad-4867-adf6-d73226b0c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f309316f-98ad-4867-adf6-d73226b0c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141063060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360f03cc-2877-48ce-8a28-2d6c5b13b6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:05Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df62362-8815-49a1-9e91-7e5e4358afda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df62362-8815-49a1-9e91-7e5e4358afda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5303416e-f6c3-433f-ab10-3cb8dfa2bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5303416e-f6c3-433f-ab10-3cb8dfa2bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360f03cc-2877-48ce-8a28-2d6c5b13b6be', 'volume_name': 'volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd0ba6d-ddc4-467d-824a-98b6b6f08c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd0ba6d-ddc4-467d-824a-98b6b6f08c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99d1c04-6a9d-4424-9194-971d62c13fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:04 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume 360f03cc-2877-48ce-8a28-2d6c5b13b6be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be', 'volume_size': 1} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:04 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd" returned: 0 in 0.661s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.300s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217017064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d946e7-4b51-4c86-a521-2e0569acec46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:04Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Creating volume 69d946e7-4b51-4c86-a521-2e0569acec46 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:39:04 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:39:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:05 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 1073741824 Jun 24 00:39:05 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590b289b-7363-4a01-89f4-6bb6c40171ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed514d0f-284a-4681-850f-7c914c5105dd', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c12c791-6565-4036-9521-ca3edc461e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume volume-ed514d0f-284a-4681-850f-7c914c5105dd (ed514d0f-284a-4681-850f-7c914c5105dd): created successfully Jun 24 00:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c12c791-6565-4036-9521-ca3edc461e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (4231f7d9-2a77-4c54-8031-084137aa851f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-abd2179c-febc-458c-8488-3743dc70e75c tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created volume successfully. Jun 24 00:39:05 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 1073741824" returned: 0 in 0.797s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:05 devstack sudo[114616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 Jun 24 00:39:05 devstack sudo[114616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:06 devstack sudo[114616]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46" returned: 0 in 0.620s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.436s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-983255091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10414e3-e19c-417c-9e72-ed3a20295470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:04Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Creating volume e10414e3-e19c-417c-9e72-ed3a20295470 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:39:06 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc53182-1637-4125-9ed5-78dd0da1969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d946e7-4b51-4c86-a521-2e0569acec46', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:06 devstack sudo[114620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 1073741824 Jun 24 00:39:06 devstack sudo[114620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12e88fe-4c0d-46f4-ba7d-ff3a7fd02ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume volume-69d946e7-4b51-4c86-a521-2e0569acec46 (69d946e7-4b51-4c86-a521-2e0569acec46): created successfully Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12e88fe-4c0d-46f4-ba7d-ff3a7fd02ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (8ab220a7-9ea1-4b1d-a321-59c820d11492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bfef2e60-a732-4948-b4d3-9cb561cbbd1b tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created volume successfully. Jun 24 00:39:07 devstack sudo[114620]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 1073741824" returned: 0 in 0.779s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:07 devstack sudo[114625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 Jun 24 00:39:07 devstack sudo[114625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:07 devstack sudo[114625]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470" returned: 0 in 0.650s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.534s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1241693248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:04Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Creating volume b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:39:07 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:07 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 1073741824 Jun 24 00:39:07 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef4222d-da14-4e96-9958-5e804af5df75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10414e3-e19c-417c-9e72-ed3a20295470', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7315d542-169c-47ac-8419-4953b9efb091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:07 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume volume-e10414e3-e19c-417c-9e72-ed3a20295470 (e10414e3-e19c-417c-9e72-ed3a20295470): created successfully Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7315d542-169c-47ac-8419-4953b9efb091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (44a6247f-3d3f-41b6-a9b8-b649b53be66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6da17f6d-b77d-45dc-9915-b3518eddd094 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created volume successfully. Jun 24 00:39:08 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 1073741824" returned: 0 in 0.799s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:08 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 Jun 24 00:39:08 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:09 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4" returned: 0 in 0.610s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.696s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141063060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360f03cc-2877-48ce-8a28-2d6c5b13b6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48be4ed99d20467d9beb0e2c46bb97d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:05Z,use_quota=True,user_id='8c9b8f7389e940c0b3b83b534bc5535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Creating volume 360f03cc-2877-48ce-8a28-2d6c5b13b6be {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:39:09 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e7a677-2c3f-4f02-abea-1c89f6bbdeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4360e512-8e89-4b31-b061-80cf4dbef40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:09 devstack sudo[114636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be 1073741824 Jun 24 00:39:09 devstack sudo[114636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:09 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 (b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4): created successfully Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4360e512-8e89-4b31-b061-80cf4dbef40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:09 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (9c5ac909-51d2-43c6-8276-cd6d2533b1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c496f705-77ed-40fd-8ce9-162c5085cb97 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created volume successfully. Jun 24 00:39:10 devstack sudo[114636]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be 1073741824" returned: 0 in 0.801s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:10 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be Jun 24 00:39:10 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:10 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be" returned: 0 in 0.654s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99d1c04-6a9d-4424-9194-971d62c13fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51551f70-d33f-4909-9f08-3b8b72b686d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Volume volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be (360f03cc-2877-48ce-8a28-2d6c5b13b6be): created successfully Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51551f70-d33f-4909-9f08-3b8b72b686d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Flow 'volume_create_manager' (c38e52b7-f416-4e08-aec6-07772d84feb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-027d3e5d-c35d-480e-b6b0-aedabd7afac1 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created volume successfully. Jun 24 00:39:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-360f03cc-2877-48ce-8a28-2d6c5b13b6be-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-360f03cc-2877-48ce-8a28-2d6c5b13b6be-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-quobyte-360f03cc-2877-48ce-8a28-2d6c5b13b6be" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-360f03cc-2877-48ce-8a28-2d6c5b13b6be" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8f29cd-83c6-4f35-bd90-c5925fcae94e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:11 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be Jun 24 00:39:11 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:12 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be" returned: 0 in 0.778s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:12 devstack sudo[114651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be Jun 24 00:39:12 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:12 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-360f03cc-2877-48ce-8a28-2d6c5b13b6be" returned: 0 in 0.623s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-360f03cc-2877-48ce-8a28-2d6c5b13b6be" released by "delete_volume" :: held 1.438s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created reservations ['e4b7bcf0-1275-48d0-93d3-20f82e50e282', '07b89888-76f1-496a-8326-944c720ebe93', '61ea53cd-e7ce-4b64-8586-2a5a77b28e60', '8c4516dd-d45d-4f05-9d0a-ed4699ef4686'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:12 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:39:12 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:13 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-quobyte-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.662s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:39:13 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Deleted volume successfully. Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0047e4a-3fbc-4607-aeed-511c1e24d7bb]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-7392f079-eb74-43e1-b048-bbe2a202e0b3 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-360f03cc-2877-48ce-8a28-2d6c5b13b6be-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:13 devstack sudo[114693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 Jun 24 00:39:13 devstack sudo[114693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:14 devstack sudo[114693]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4" returned: 0 in 0.760s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:14 devstack sudo[114698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4 Jun 24 00:39:14 devstack sudo[114698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:14 devstack sudo[114698]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4" returned: 0 in 0.632s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4" released by "delete_volume" :: held 1.432s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:14 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created reservations ['3daccc8a-f985-4b2c-aa5d-9fb986d7cffd', '893b8c06-841d-4219-9c6f-70b9554de88b', 'a7472727-9619-4203-9012-0b25364abec5', '6a42587a-5734-41f3-8739-9c6cf24fa4f4'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:15 devstack sudo[114702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:39:15 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-e10414e3-e19c-417c-9e72-ed3a20295470-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-e10414e3-e19c-417c-9e72-ed3a20295470-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:15 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.703s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-quobyte-e10414e3-e19c-417c-9e72-ed3a20295470" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Deleted volume successfully. Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-e10414e3-e19c-417c-9e72-ed3a20295470" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-30392385-7eac-45e9-94ac-b23226c79186 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-b4c274b4-2d72-41f8-a23c-2ae30fcdd7d4-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f13c94a-7a97-4f60-8e04-d41559a96ed0]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:15 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 Jun 24 00:39:15 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:16 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470" returned: 0 in 0.751s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:16 devstack sudo[114711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470 Jun 24 00:39:16 devstack sudo[114711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:17 devstack sudo[114711]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e10414e3-e19c-417c-9e72-ed3a20295470" returned: 0 in 0.654s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-e10414e3-e19c-417c-9e72-ed3a20295470" released by "delete_volume" :: held 1.453s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created reservations ['1d8aa775-5fc7-4792-bd0f-8a071461ba6b', 'a64617b2-74d6-427a-b17d-4f4e6add09c4', '7103ad06-1658-4951-b8da-1a0468cf4195', '0add7aed-495e-4324-a8e6-6025a2f421d5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:17 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:39:17 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-69d946e7-4b51-4c86-a521-2e0569acec46-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-69d946e7-4b51-4c86-a521-2e0569acec46-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:17 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.644s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:17 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:39:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-quobyte-69d946e7-4b51-4c86-a521-2e0569acec46" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:18 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Deleted volume successfully. Jun 24 00:39:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-49a35658-4dd4-4951-ac57-7f095f8d9144 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-e10414e3-e19c-417c-9e72-ed3a20295470-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-69d946e7-4b51-4c86-a521-2e0569acec46" acquired by "delete_volume" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:18 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a943de4-8178-48bf-9fde-7ee6ba9d11f1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:18 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 Jun 24 00:39:18 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:18 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46" returned: 0 in 0.718s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:18 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46 Jun 24 00:39:18 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:19 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-69d946e7-4b51-4c86-a521-2e0569acec46" returned: 0 in 0.622s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-69d946e7-4b51-4c86-a521-2e0569acec46" released by "delete_volume" :: held 1.381s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created reservations ['29184d5b-50b0-411d-8b84-341e859f0294', 'e6cf8172-9849-47ce-82f6-e2893a46a87d', 'd60e4ae9-802b-4180-aff5-7e4be54e00b5', 'e4d5f72d-62b4-4bf7-9387-14380660d188'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:19 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:39:19 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:20 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.641s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:39:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Deleted volume successfully. Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e1f3f382-3c1e-4ba0-92ba-92082a51aebd tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-69d946e7-4b51-4c86-a521-2e0569acec46-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-ed514d0f-284a-4681-850f-7c914c5105dd-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-ed514d0f-284a-4681-850f-7c914c5105dd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-quobyte-ed514d0f-284a-4681-850f-7c914c5105dd" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-ed514d0f-284a-4681-850f-7c914c5105dd" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0600d-2218-4297-89f6-c90924b422bb]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:20 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd Jun 24 00:39:20 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:20 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd" returned: 0 in 0.702s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:21 devstack sudo[114736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd Jun 24 00:39:21 devstack sudo[114736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:21 devstack sudo[114736]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ed514d0f-284a-4681-850f-7c914c5105dd" returned: 0 in 0.612s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-ed514d0f-284a-4681-850f-7c914c5105dd" released by "delete_volume" :: held 1.360s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created reservations ['5e542020-3a36-4030-a99f-2aafdecd31ca', 'a4ed0de9-2ede-4c19-89e3-b00f53de59fd', '78eb22fe-f0fd-4697-b6c5-f65e6953cdff', 'f922fa23-5f96-4003-b710-c40d0f6456e8'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:21 devstack sudo[114739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:39:21 devstack sudo[114739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:22 devstack sudo[114739]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.633s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:39:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Deleted volume successfully. Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-94b22b38-52c2-4f6d-978d-083a2b6c54a2 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-ed514d0f-284a-4681-850f-7c914c5105dd-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-abff72aa-9dd7-47e5-b1be-6b2fa66873d8-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-abff72aa-9dd7-47e5-b1be-6b2fa66873d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-quobyte-aa4b723c-75f1-440b-b092-75a96814dfc5" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-aa4b723c-75f1-440b-b092-75a96814dfc5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-quobyte-abff72aa-9dd7-47e5-b1be-6b2fa66873d8" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-abff72aa-9dd7-47e5-b1be-6b2fa66873d8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Deleting offline snapshot abff72aa-9dd7-47e5-b1be-6b2fa66873d8 of volume aa4b723c-75f1-440b-b092-75a96814dfc5 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] snapshot_file for this snap is: volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1a47a8-ea78-4862-aa5c-3bddea203ae4]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:22 devstack sudo[114742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 Jun 24 00:39:22 devstack sudo[114742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:23 devstack sudo[114742]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8" returned: 0 in 0.742s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa4b723c-75f1-440b-b092-75a96814dfc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:39:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f765009b-9a51-4735-beff-eeaf0fe91bde]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:23 devstack sudo[114747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 Jun 24 00:39:23 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:24 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5" returned: 0 in 0.713s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:24 devstack sudo[114752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 Jun 24 00:39:24 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:24 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8" returned: 0 in 0.728s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:24 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8 Jun 24 00:39:24 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:25 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5.abff72aa-9dd7-47e5-b1be-6b2fa66873d8" returned: 0 in 0.611s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-abff72aa-9dd7-47e5-b1be-6b2fa66873d8" released by "_delete_snapshot" :: held 2.884s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-aa4b723c-75f1-440b-b092-75a96814dfc5" released by "delete_snapshot" :: held 2.905s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created reservations ['82d17f31-842a-4df3-a246-c87ec1baa6c5', '10e2fd79-ba16-4f39-8417-8d310ae7794a', 'f3683943-414d-44d4-931b-e73f83926f0b', 'bcd4d52b-c31e-4aac-a515-92476627cdcf'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:39:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Delete snapshot completed successfully. Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fc7a460c-ace1-4c3e-9919-d7249e557e08 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-abff72aa-9dd7-47e5-b1be-6b2fa66873d8-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-aa4b723c-75f1-440b-b092-75a96814dfc5-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-aa4b723c-75f1-440b-b092-75a96814dfc5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "cinder-quobyte-aa4b723c-75f1-440b-b092-75a96814dfc5" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-aa4b723c-75f1-440b-b092-75a96814dfc5" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c1b8b-dd10-4eb1-99bf-917ae9084370]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:25 devstack sudo[114760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 Jun 24 00:39:25 devstack sudo[114760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:26 devstack sudo[114760]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5" returned: 0 in 0.716s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:26 devstack sudo[114766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5 Jun 24 00:39:26 devstack sudo[114766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:27 devstack sudo[114766]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-aa4b723c-75f1-440b-b092-75a96814dfc5" returned: 0 in 0.638s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-quobyte-aa4b723c-75f1-440b-b092-75a96814dfc5" released by "delete_volume" :: held 1.407s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Created reservations ['ed3f720f-dfb6-47ec-9c9f-0fb640c8aa6d', '15ce723b-8125-4f6e-ade2-b2225fc4bfbe', 'd4270f6f-2240-4dfe-91a1-84320a40f3f0', 'f7d2b9df-6d3d-4dda-973c-1886d2ea25d5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:27 devstack sudo[114769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:39:27 devstack sudo[114769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:27 devstack sudo[114769]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.652s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:39:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Deleted volume successfully. Jun 24 00:39:27 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2da4eea9-b138-4fb7-8604-3ff6c2acffd4 tempest-CreateVolumesFromSnapshotTest-1428768152 None] Lock "cinder-aa4b723c-75f1-440b-b092-75a96814dfc5-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Flow 'volume_create_manager' (c7fefd45-383e-4a61-934e-fb66ed20e6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442490de-0bd1-4dfd-b5c0-f6be691e867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442490de-0bd1-4dfd-b5c0-f6be691e867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fddd7a6-de51-4658-b112-8af1b77b7ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a90b87f5a014c16b1da0d1c77f49598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:33Z,use_quota=True,user_id='08cedd6905034be6a5697a94ca2160ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec350ab9-cecb-44b1-947d-de927319eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec350ab9-cecb-44b1-947d-de927319eb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac64c9db-e82a-4942-ac40-a13d8755b1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:32 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac64c9db-e82a-4942-ac40-a13d8755b1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fddd7a6-de51-4658-b112-8af1b77b7ee6', 'volume_name': 'volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6', 'volume_size': 1, 'image_id': '0441c272-ff58-488e-92f8-b046195cac6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0441c272-ff58-488e-92f8-b046195cac6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79f9ef7faeae9765ed34e73c3105fc5a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a90b87f5a014c16b1da0d1c77f49598', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b402d6958a488f521c1d368926ccd0cc577d4d329375316077fb3ec95f75336ac52cc2ce658f088ea0e9a235f1c0e9ea0c0f7eb37a37763abbd40fa2889636b1', 'id': '0441c272-ff58-488e-92f8-b046195cac6b', 'created_at': datetime.datetime(2026, 6, 23, 22, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0441c272-ff58-488e-92f8-b046195cac6b/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdab36b7-bb3a-40c1-881e-aa0732df3f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdab36b7-bb3a-40c1-881e-aa0732df3f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac63402-d9fa-42bc-bc9e-f4dfadb40d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Volume 8fddd7a6-de51-4658-b112-8af1b77b7ee6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6', 'volume_size': 1, 'image_id': '0441c272-ff58-488e-92f8-b046195cac6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0441c272-ff58-488e-92f8-b046195cac6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79f9ef7faeae9765ed34e73c3105fc5a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a90b87f5a014c16b1da0d1c77f49598', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b402d6958a488f521c1d368926ccd0cc577d4d329375316077fb3ec95f75336ac52cc2ce658f088ea0e9a235f1c0e9ea0c0f7eb37a37763abbd40fa2889636b1', 'id': '0441c272-ff58-488e-92f8-b046195cac6b', 'created_at': datetime.datetime(2026, 6, 23, 22, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0441c272-ff58-488e-92f8-b046195cac6b/file', 'properties': {}}, 'image_service': } Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Trying to clone 8fddd7a6-de51-4658-b112-8af1b77b7ee6 from image 0441c272-ff58-488e-92f8-b046195cac6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/0441c272-ff58-488e-92f8-b046195cac6b', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:39:33 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Image download 0.00 MB at 0.00 MB/s Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e911d5c-2832-4e8e-89a6-07d21b1854de]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:33 devstack sudo[114773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD Jun 24 00:39:33 devstack sudo[114773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:33 devstack sudo[114773]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD" returned: 0 in 0.686s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:34 devstack sudo[114777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD Jun 24 00:39:34 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:34 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD" returned: 1 in 0.684s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:39:34 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Temporary image 0441c272-ff58-488e-92f8-b046195cac6b is fetched for user 08cedd6905034be6a5697a94ca2160ee. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:39:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[719ab9ab-97b2-4491-8e20-9506a6dd715e]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:34 devstack sudo[114782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD Jun 24 00:39:34 devstack sudo[114782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:35 devstack sudo[114782]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD" returned: 0 in 0.696s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:35 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD Jun 24 00:39:35 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:36 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD" returned: 1 in 0.681s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fddd7a6-de51-4658-b112-8af1b77b7ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a90b87f5a014c16b1da0d1c77f49598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:33Z,use_quota=True,user_id='08cedd6905034be6a5697a94ca2160ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Creating volume 8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:39:36 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:36 devstack sudo[114791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 1073741824 Jun 24 00:39:36 devstack sudo[114791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:36 devstack sudo[114791]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 1073741824" returned: 0 in 0.773s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:36 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 Jun 24 00:39:36 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:37 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6" returned: 0 in 0.616s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:39:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:37 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Attempting download of 0441c272-ff58-488e-92f8-b046195cac6b ((None, [{'url': 'file:///opt/stack/data/glance/images/0441c272-ff58-488e-92f8-b046195cac6b', 'metadata': {}}])) to volume 8fddd7a6-de51-4658-b112-8af1b77b7ee6. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:39:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2047a4a5-82ca-4873-ad01-db52f7e6f019]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0441c272-ff58-488e-92f8-b046195cac6b_fu5ri_s2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:37 devstack sudo[114800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0441c272-ff58-488e-92f8-b046195cac6b_fu5ri_s2 Jun 24 00:39:37 devstack sudo[114800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:38 devstack sudo[114800]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0441c272-ff58-488e-92f8-b046195cac6b_fu5ri_s2" returned: 0 in 0.694s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0441c272-ff58-488e-92f8-b046195cac6b_fu5ri_s2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:38 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0441c272-ff58-488e-92f8-b046195cac6b_fu5ri_s2 Jun 24 00:39:38 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:38 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0441c272-ff58-488e-92f8-b046195cac6b_fu5ri_s2" returned: 1 in 0.684s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0441c272-ff58-488e-92f8-b046195cac6b_fu5ri_s2' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:39:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd04cc07-b694-4758-b6c0-1a34cd0090dd]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:39 devstack sudo[114808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD Jun 24 00:39:39 devstack sudo[114808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:39 devstack sudo[114808]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD" returned: 0 in 0.678s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:39 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD Jun 24 00:39:39 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:39 devstack sudo[114813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:39:39 devstack sudo[114813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:40 devstack sudo[114813]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.625s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:39:40 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD" returned: 1 in 0.723s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] 0441c272-ff58-488e-92f8-b046195cac6b was raw, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:39:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:40 devstack sudo[114820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 Jun 24 00:39:40 devstack sudo[114820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:41 devstack sudo[114820]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6" returned: 0 in 0.677s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:41 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0441c272-ff58-488e-92f8-b046195cac6b_5g01htg5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:39:41 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 00:39:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:41 devstack sudo[114825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 1G Jun 24 00:39:41 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:41 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 1G" returned: 0 in 0.646s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0aec1a-c896-4c85-a684-a7f9f1f534f7]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:41 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 Jun 24 00:39:41 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:42 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6" returned: 0 in 0.710s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:42 devstack sudo[114834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 Jun 24 00:39:42 devstack sudo[114834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:43 devstack sudo[114834]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6" returned: 1 in 0.735s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Downloaded image 0441c272-ff58-488e-92f8-b046195cac6b ((None, [{'url': 'file:///opt/stack/data/glance/images/0441c272-ff58-488e-92f8-b046195cac6b', 'metadata': {}}])) to volume 8fddd7a6-de51-4658-b112-8af1b77b7ee6 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Temporary image 0441c272-ff58-488e-92f8-b046195cac6b for user 08cedd6905034be6a5697a94ca2160ee is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Marking volume 8fddd7a6-de51-4658-b112-8af1b77b7ee6 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Copying metadata from image 0441c272-ff58-488e-92f8-b046195cac6b to 8fddd7a6-de51-4658-b112-8af1b77b7ee6. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Creating volume glance metadata for volume 8fddd7a6-de51-4658-b112-8af1b77b7ee6 backed by image 0441c272-ff58-488e-92f8-b046195cac6b with: {'image_id': '0441c272-ff58-488e-92f8-b046195cac6b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '79f9ef7faeae9765ed34e73c3105fc5a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac63402-d9fa-42bc-bc9e-f4dfadb40d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6', 'volume_size': 1, 'image_id': '0441c272-ff58-488e-92f8-b046195cac6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0441c272-ff58-488e-92f8-b046195cac6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79f9ef7faeae9765ed34e73c3105fc5a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a90b87f5a014c16b1da0d1c77f49598', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b402d6958a488f521c1d368926ccd0cc577d4d329375316077fb3ec95f75336ac52cc2ce658f088ea0e9a235f1c0e9ea0c0f7eb37a37763abbd40fa2889636b1', 'id': '0441c272-ff58-488e-92f8-b046195cac6b', 'created_at': datetime.datetime(2026, 6, 23, 22, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0441c272-ff58-488e-92f8-b046195cac6b/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb42d70c-8d0b-4023-ada3-16b8b172a42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Volume volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 (8fddd7a6-de51-4658-b112-8af1b77b7ee6): created successfully Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb42d70c-8d0b-4023-ada3-16b8b172a42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Flow 'volume_create_manager' (c7fefd45-383e-4a61-934e-fb66ed20e6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1c0dbac8-0b5e-43f6-adcf-92914abb1770 tempest-VolumeImageDependencyTests-913366247 None] Created volume successfully. Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Acquiring lock "cinder-8fddd7a6-de51-4658-b112-8af1b77b7ee6-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Lock "cinder-8fddd7a6-de51-4658-b112-8af1b77b7ee6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Acquiring lock "cinder-quobyte-8fddd7a6-de51-4658-b112-8af1b77b7ee6" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Lock "cinder-quobyte-8fddd7a6-de51-4658-b112-8af1b77b7ee6" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[02759af2-4451-4a90-9212-da518bd6544e]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:43 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 Jun 24 00:39:43 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:44 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6" returned: 0 in 0.739s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:44 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 Jun 24 00:39:44 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:45 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6" returned: 1 in 0.720s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:45 devstack sudo[114854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6 Jun 24 00:39:45 devstack sudo[114854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:45 devstack sudo[114854]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-8fddd7a6-de51-4658-b112-8af1b77b7ee6" returned: 0 in 0.603s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Lock "cinder-quobyte-8fddd7a6-de51-4658-b112-8af1b77b7ee6" released by "delete_volume" :: held 2.120s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Created reservations ['6837b700-c24a-4d16-8652-305bcfa09bee', '6a4cc2cd-3b25-403e-9efd-244a30478a7d', 'f276c8d1-6bce-4c59-884a-425c840e0a9d', 'c2a25a80-f015-48cb-b04e-61166e9229d5'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:45 devstack sudo[114857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:39:45 devstack sudo[114857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:46 devstack sudo[114857]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.597s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:46 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:39:46 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Deleted volume successfully. Jun 24 00:39:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9607c327-bbc7-4cf8-af70-591fd5e55adf tempest-VolumeImageDependencyTests-913366247 None] Lock "cinder-8fddd7a6-de51-4658-b112-8af1b77b7ee6-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Flow 'volume_create_manager' (97fb0f24-5ae8-46ae-8917-777b1b7d1975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e777d0-ceac-4c30-9116-21e65a5f99d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e777d0-ceac-4c30-9116-21e65a5f99d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118be875-89ee-4d3a-a482-e68b2f0c2fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a632e7fc0f249d3af668c37bd966adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:49Z,use_quota=True,user_id='a1eb748fdff84776a5caf74c2923103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52416b13-709c-48ff-a3c4-d7184fce42df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52416b13-709c-48ff-a3c4-d7184fce42df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a9a98b-b147-41c3-8c61-b72f360f7c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a9a98b-b147-41c3-8c61-b72f360f7c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118be875-89ee-4d3a-a482-e68b2f0c2fab', 'volume_name': 'volume-118be875-89ee-4d3a-a482-e68b2f0c2fab', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40068a8d-eb7f-4a0e-9f40-1ee7ecb849c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40068a8d-eb7f-4a0e-9f40-1ee7ecb849c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e083e90b-426a-493b-b8c9-627430f308d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:49 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Volume 118be875-89ee-4d3a-a482-e68b2f0c2fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118be875-89ee-4d3a-a482-e68b2f0c2fab', 'volume_size': 1} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118be875-89ee-4d3a-a482-e68b2f0c2fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a632e7fc0f249d3af668c37bd966adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:49Z,use_quota=True,user_id='a1eb748fdff84776a5caf74c2923103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Creating volume 118be875-89ee-4d3a-a482-e68b2f0c2fab {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:39:49 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:39:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:49 devstack sudo[114861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab 1073741824 Jun 24 00:39:49 devstack sudo[114861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:50 devstack sudo[114861]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab 1073741824" returned: 0 in 0.753s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:50 devstack sudo[114866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab Jun 24 00:39:50 devstack sudo[114866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:50 devstack sudo[114866]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab" returned: 0 in 0.615s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e083e90b-426a-493b-b8c9-627430f308d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118be875-89ee-4d3a-a482-e68b2f0c2fab', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bb278b-b339-45d6-bc1a-af72e9e1f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:50 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Volume volume-118be875-89ee-4d3a-a482-e68b2f0c2fab (118be875-89ee-4d3a-a482-e68b2f0c2fab): created successfully Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bb278b-b339-45d6-bc1a-af72e9e1f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Flow 'volume_create_manager' (97fb0f24-5ae8-46ae-8917-777b1b7d1975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7be99b9b-c574-4570-b6eb-70deb2d67da5 tempest-CinderUnicodeTest-1136758172 None] Created volume successfully. Jun 24 00:39:51 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:39:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Flow 'volume_create_manager' (a13969d2-9839-4089-af83-603f1f89c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb979b32-0bbd-4ffa-92c5-c865573d1182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb979b32-0bbd-4ffa-92c5-c865573d1182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-25427289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fafef5-a20e-481a-8a74-b8a6dc879801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a632e7fc0f249d3af668c37bd966adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:52Z,use_quota=True,user_id='a1eb748fdff84776a5caf74c2923103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74529d2f-7a3f-457c-93d4-f9895c001ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74529d2f-7a3f-457c-93d4-f9895c001ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23786fed-d545-43db-b31e-9ee0aa7af02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23786fed-d545-43db-b31e-9ee0aa7af02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96fafef5-a20e-481a-8a74-b8a6dc879801', 'volume_name': 'volume-96fafef5-a20e-481a-8a74-b8a6dc879801', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbe71df-eb60-43b4-8c98-46c6ce6a366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbe71df-eb60-43b4-8c98-46c6ce6a366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840afe00-da6c-4a22-a3f0-231f0b007686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Volume 96fafef5-a20e-481a-8a74-b8a6dc879801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96fafef5-a20e-481a-8a74-b8a6dc879801', 'volume_size': 1} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:39:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-25427289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fafef5-a20e-481a-8a74-b8a6dc879801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a632e7fc0f249d3af668c37bd966adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:39:52Z,use_quota=True,user_id='a1eb748fdff84776a5caf74c2923103d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Creating volume 96fafef5-a20e-481a-8a74-b8a6dc879801 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:39:52 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:52 devstack sudo[114869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 1073741824 Jun 24 00:39:52 devstack sudo[114869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:52 devstack sudo[114869]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 1073741824" returned: 0 in 0.758s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:52 devstack sudo[114874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 Jun 24 00:39:52 devstack sudo[114874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:53 devstack sudo[114874]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801" returned: 0 in 0.609s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:39:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840afe00-da6c-4a22-a3f0-231f0b007686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fafef5-a20e-481a-8a74-b8a6dc879801', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2822b23d-7d9d-4d7a-a946-673780036cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:39:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Volume volume-96fafef5-a20e-481a-8a74-b8a6dc879801 (96fafef5-a20e-481a-8a74-b8a6dc879801): created successfully Jun 24 00:39:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2822b23d-7d9d-4d7a-a946-673780036cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:39:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Flow 'volume_create_manager' (a13969d2-9839-4089-af83-603f1f89c813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:39:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-84129820-f703-4d1c-b7c7-5b1720d1f563 tempest-CinderUnicodeTest-1136758172 None] Created volume successfully. Jun 24 00:39:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:39:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:39:54 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Creating offline snapshot 1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb of volume 96fafef5-a20e-481a-8a74-b8a6dc879801 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:39:54 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fbd51-d8a0-4531-aac1-9210445bd212]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:54 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 Jun 24 00:39:54 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:54 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801" returned: 0 in 0.713s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:54 devstack sudo[114882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb 1G Jun 24 00:39:54 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:55 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb 1G" returned: 0 in 0.752s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fafef5-a20e-481a-8a74-b8a6dc879801 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:55 devstack sudo[114888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fafef5-a20e-481a-8a74-b8a6dc879801 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb Jun 24 00:39:55 devstack sudo[114888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:56 devstack sudo[114888]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fafef5-a20e-481a-8a74-b8a6dc879801 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb" returned: 0 in 0.651s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:56 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb is being set with open permissions: ugo+rw Jun 24 00:39:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:56 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb Jun 24 00:39:56 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:57 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb" returned: 0 in 0.641s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:57 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=72,cinder:UPDATE=91,cinder:INSERT=25,cinder:DELETE=10 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:39:57 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=93,cinder:SELECT=67,cinder:INSERT=26,cinder:DELETE=7 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:39:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:57 devstack sudo[114897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.info Jun 24 00:39:57 devstack sudo[114897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:57 devstack sudo[114897]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.info" returned: 0 in 0.637s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:57 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.info is being set with open permissions: ugo+rw Jun 24 00:39:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:57 devstack sudo[114900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.info Jun 24 00:39:57 devstack sudo[114900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:39:58 devstack sudo[114900]: pam_unix(sudo:session): session closed for user root Jun 24 00:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.info" returned: 0 in 0.606s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:39:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.099s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:39:58 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-dbf550c7-bcf4-4c91-8338-ab97bfd579d4 tempest-CinderUnicodeTest-1136758172 None] Create snapshot completed successfully Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "cinder-1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "cinder-quobyte-96fafef5-a20e-481a-8a74-b8a6dc879801" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-quobyte-96fafef5-a20e-481a-8a74-b8a6dc879801" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "cinder-quobyte-1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-quobyte-1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Deleting offline snapshot 1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb of volume 96fafef5-a20e-481a-8a74-b8a6dc879801 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] snapshot_file for this snap is: volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38b464d-68dc-4853-89de-f633674dfbd6]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:39:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:39:59 devstack sudo[114903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb Jun 24 00:39:59 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:00 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb" returned: 0 in 0.714s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96fafef5-a20e-481a-8a74-b8a6dc879801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:40:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb289854-8d7d-4edd-a280-e200f806a477]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:00 devstack sudo[114908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 Jun 24 00:40:00 devstack sudo[114908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:00 devstack sudo[114908]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801" returned: 0 in 0.712s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:01 devstack sudo[114914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb Jun 24 00:40:01 devstack sudo[114914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:01 devstack sudo[114914]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb" returned: 0 in 0.716s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:01 devstack sudo[114919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb Jun 24 00:40:01 devstack sudo[114919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:02 devstack sudo[114919]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801.1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb" returned: 0 in 0.638s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-quobyte-1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb" released by "_delete_snapshot" :: held 2.891s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-quobyte-96fafef5-a20e-481a-8a74-b8a6dc879801" released by "delete_snapshot" :: held 2.915s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Created reservations ['dc129d6a-4e24-458b-bf5c-af618ec21450', 'c033982a-4172-4d5b-b9db-d11dfb44a25a', 'd9cf78dd-98b9-4e4e-a654-6e14a5b0e96b', '9062785b-b75e-4900-b79a-43975961afb0'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Delete snapshot completed successfully. Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c65f82f2-1fce-4152-aabc-3c0a7ffa903b tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-1c7bb2f4-2d59-40ab-9274-0ffd5959f3eb-delete_snapshot" released by "delete_snapshot" :: held 3.036s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "cinder-96fafef5-a20e-481a-8a74-b8a6dc879801-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-96fafef5-a20e-481a-8a74-b8a6dc879801-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "cinder-quobyte-96fafef5-a20e-481a-8a74-b8a6dc879801" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-quobyte-96fafef5-a20e-481a-8a74-b8a6dc879801" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe8105-a905-41cc-867e-44d1692c9647]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:02 devstack sudo[114922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 Jun 24 00:40:02 devstack sudo[114922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:03 devstack sudo[114922]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801" returned: 0 in 0.736s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:03 devstack sudo[114927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801 Jun 24 00:40:03 devstack sudo[114927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:04 devstack sudo[114927]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-96fafef5-a20e-481a-8a74-b8a6dc879801" returned: 0 in 0.631s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-quobyte-96fafef5-a20e-481a-8a74-b8a6dc879801" released by "delete_volume" :: held 1.443s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Created reservations ['fbe7492c-1a6b-4a97-8b58-8e865fe621d6', '35ae9ffc-3d5c-454c-a24d-1e7f45a62d7f', 'db5fb36e-c486-4a2b-ab5a-5062388deb08', 'e0864966-e508-4706-8a8b-29a35182dc77'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:04 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:04 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:04 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.603s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:04 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Deleted volume successfully. Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "cinder-118be875-89ee-4d3a-a482-e68b2f0c2fab-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-118be875-89ee-4d3a-a482-e68b2f0c2fab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ecf50344-d476-4ed9-8b23-078c6d6a78ca tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-96fafef5-a20e-481a-8a74-b8a6dc879801-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "cinder-quobyte-118be875-89ee-4d3a-a482-e68b2f0c2fab" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-quobyte-118be875-89ee-4d3a-a482-e68b2f0c2fab" acquired by "delete_volume" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c52e34b-3234-4de4-b179-87452182c97d]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:05 devstack sudo[114933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab Jun 24 00:40:05 devstack sudo[114933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:05 devstack sudo[114933]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab" returned: 0 in 0.711s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:05 devstack sudo[114938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab Jun 24 00:40:05 devstack sudo[114938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:06 devstack sudo[114938]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-118be875-89ee-4d3a-a482-e68b2f0c2fab" returned: 0 in 0.591s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-quobyte-118be875-89ee-4d3a-a482-e68b2f0c2fab" released by "delete_volume" :: held 1.345s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Created reservations ['6e031c7a-1c65-4484-907d-320b7d5c8463', '8c2c6693-15b5-43c4-8bbd-0d4123028f75', 'e82da81d-4517-4a42-b95b-36c2b89d1ffa', '2dca8d1c-fb5b-4e55-875d-9402cb3b706b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:06 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:06 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:06 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.616s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:07 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Deleted volume successfully. Jun 24 00:40:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-78ba4ae2-23da-4505-b797-d39765c38f0e tempest-CinderUnicodeTest-1136758172 None] Lock "cinder-118be875-89ee-4d3a-a482-e68b2f0c2fab-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:16 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=12,cinder:DELETE=2,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:40:17 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (6ff3a111-44d6-4906-98a6-798c0d6f527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d6e8f2-0815-4977-a4f9-b94512b152af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d6e8f2-0815-4977-a4f9-b94512b152af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1345795717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480560ad-7e6a-4418-953f-106206ce3582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:19Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2e4890-3257-4845-b19c-1f6fc55881c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2e4890-3257-4845-b19c-1f6fc55881c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b671f4-ae4e-42fa-919d-0220605778c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b671f4-ae4e-42fa-919d-0220605778c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480560ad-7e6a-4418-953f-106206ce3582', 'volume_name': 'volume-480560ad-7e6a-4418-953f-106206ce3582', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8d79f2-751e-40fb-8622-3e128d2f12b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8d79f2-751e-40fb-8622-3e128d2f12b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d05dd0b-76cd-4398-9c0a-d9f6f0868353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:18 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Volume 480560ad-7e6a-4418-953f-106206ce3582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480560ad-7e6a-4418-953f-106206ce3582', 'volume_size': 1} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1345795717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480560ad-7e6a-4418-953f-106206ce3582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:19Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Creating volume 480560ad-7e6a-4418-953f-106206ce3582 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:18 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:18 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 1073741824 Jun 24 00:40:18 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Flow 'volume_create_manager' (ee4ad3d9-a277-4374-82a1-980a3c23b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2995592-5bb5-44d3-bdce-8684140671f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2995592-5bb5-44d3-bdce-8684140671f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-540025348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c937e1fa-0fb5-4d49-ac2a-082dfc13517b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b9b2ed30dc4f97b3e37842bc319cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:19Z,use_quota=True,user_id='5835f15308eb4a6eaea12b42dc13f5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95090ee2-d04d-4057-bf3c-110f44480026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95090ee2-d04d-4057-bf3c-110f44480026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb5fb3a-f663-4834-9766-1d16eb907655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb5fb3a-f663-4834-9766-1d16eb907655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c937e1fa-0fb5-4d49-ac2a-082dfc13517b', 'volume_name': 'volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd8338a-f5e9-4ed7-a435-584d182bc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd8338a-f5e9-4ed7-a435-584d182bc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045a20fa-e3ef-4231-8aa6-643b88dd7b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Volume c937e1fa-0fb5-4d49-ac2a-082dfc13517b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b', 'volume_size': 1} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (0804ec78-11df-4607-a23a-57fb7aa0e009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99e61bf-7828-4d65-a7f0-9794606f7a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99e61bf-7828-4d65-a7f0-9794606f7a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-22841016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005aa91d-670f-4a10-b69f-415129e4aad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:20Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5245fa-bfad-4d0b-952f-e2c4799f375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5245fa-bfad-4d0b-952f-e2c4799f375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe36f73-4b54-49a8-bfee-568210aaf210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe36f73-4b54-49a8-bfee-568210aaf210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005aa91d-670f-4a10-b69f-415129e4aad3', 'volume_name': 'volume-005aa91d-670f-4a10-b69f-415129e4aad3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bb6b06-a131-41be-bfa9-32245be8adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bb6b06-a131-41be-bfa9-32245be8adeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bfd3a4-2b1e-4047-810b-642fa8003a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Volume 005aa91d-670f-4a10-b69f-415129e4aad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005aa91d-670f-4a10-b69f-415129e4aad3', 'volume_size': 1} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (eee129ea-9671-41a9-a5b4-938e540553b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284b1222-166c-44c2-985c-4a4518c9264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284b1222-166c-44c2-985c-4a4518c9264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241381699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099e21c4-943d-4028-992f-01e121a7f511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:20Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9132ab-59bf-4424-8cf2-da75e697a543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9132ab-59bf-4424-8cf2-da75e697a543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ff0cde-f41d-485e-a17e-110dcc1f91b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ff0cde-f41d-485e-a17e-110dcc1f91b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '099e21c4-943d-4028-992f-01e121a7f511', 'volume_name': 'volume-099e21c4-943d-4028-992f-01e121a7f511', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5decdf52-31b2-46b3-be9f-9138c8d8a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5decdf52-31b2-46b3-be9f-9138c8d8a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301aefd9-d7f9-49e3-b563-2db620ff05a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:19 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume 099e21c4-943d-4028-992f-01e121a7f511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-099e21c4-943d-4028-992f-01e121a7f511', 'volume_size': 1} Jun 24 00:40:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:20 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 1073741824" returned: 0 in 1.171s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (3c592ee0-bbe9-484c-abff-a7a0831cc275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849f3ac3-c94f-4cf2-9752-3818bbbd4d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:20 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 Jun 24 00:40:20 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849f3ac3-c94f-4cf2-9752-3818bbbd4d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356680158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42eac910-37af-4b4b-abb2-75d91d52bfa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:20Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5d4f60-ea70-4ac5-b1c6-23881cc893bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5d4f60-ea70-4ac5-b1c6-23881cc893bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a49a4d9-847e-4e49-9d1c-6ba196dc2be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a49a4d9-847e-4e49-9d1c-6ba196dc2be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42eac910-37af-4b4b-abb2-75d91d52bfa0', 'volume_name': 'volume-42eac910-37af-4b4b-abb2-75d91d52bfa0', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e522427-5e10-4814-b225-81d78d0199e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e522427-5e10-4814-b225-81d78d0199e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5f0c61-8cf6-42fc-a2e8-6c83945d67c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Volume 42eac910-37af-4b4b-abb2-75d91d52bfa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42eac910-37af-4b4b-abb2-75d91d52bfa0', 'volume_size': 1} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (a4f94f19-76fb-4f89-85fc-1bfd74bc475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0442d444-cc0c-456b-9fad-e2b4f15f4eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0442d444-cc0c-456b-9fad-e2b4f15f4eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2024690518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7286a4-796b-410d-97c5-742e0392a923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:20Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dbd4ea-77fa-4a93-9db6-45a5e94d8010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dbd4ea-77fa-4a93-9db6-45a5e94d8010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b929a8b-e167-487b-ad56-3ac6d7d965d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b929a8b-e167-487b-ad56-3ac6d7d965d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7286a4-796b-410d-97c5-742e0392a923', 'volume_name': 'volume-1f7286a4-796b-410d-97c5-742e0392a923', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635c725c-ed42-4995-b961-50a229d13c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635c725c-ed42-4995-b961-50a229d13c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e628b0-0abe-4c2c-b8d4-fe7b91453492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:20 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Volume 1f7286a4-796b-410d-97c5-742e0392a923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7286a4-796b-410d-97c5-742e0392a923', 'volume_size': 1} Jun 24 00:40:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:21 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582" returned: 0 in 0.819s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.842s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-540025348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c937e1fa-0fb5-4d49-ac2a-082dfc13517b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b9b2ed30dc4f97b3e37842bc319cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:19Z,use_quota=True,user_id='5835f15308eb4a6eaea12b42dc13f5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Creating volume c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:21 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d05dd0b-76cd-4398-9c0a-d9f6f0868353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480560ad-7e6a-4418-953f-106206ce3582', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:21 devstack sudo[115036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b 1073741824 Jun 24 00:40:21 devstack sudo[115036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b84bbd3-ad99-4c36-9e9b-797573956035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:21 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Volume volume-480560ad-7e6a-4418-953f-106206ce3582 (480560ad-7e6a-4418-953f-106206ce3582): created successfully Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b84bbd3-ad99-4c36-9e9b-797573956035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (6ff3a111-44d6-4906-98a6-798c0d6f527f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2f0b85bc-db2c-4b6b-86ad-f0cba8a070f6 tempest-CreateVolumesFromImageTest-1868610851 None] Created volume successfully. Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (b13f6881-d3cd-49a7-93d9-3edb1dc8db89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1947d31-dd8b-4b0a-9eb7-74f433cca877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1947d31-dd8b-4b0a-9eb7-74f433cca877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1565212125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a47721e-006c-49b8-b3b5-7389a2febcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:21Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e111350e-3a71-43b1-93d2-cbdf7c278c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e111350e-3a71-43b1-93d2-cbdf7c278c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee411703-97a4-49e8-a540-19fdc8a47172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee411703-97a4-49e8-a540-19fdc8a47172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a47721e-006c-49b8-b3b5-7389a2febcd9', 'volume_name': 'volume-1a47721e-006c-49b8-b3b5-7389a2febcd9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce8b644-4ae0-4cdf-945d-38de2391685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce8b644-4ae0-4cdf-945d-38de2391685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c44f3d-f9ff-46d2-a544-f586cd214cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:21 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Volume 1a47721e-006c-49b8-b3b5-7389a2febcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a47721e-006c-49b8-b3b5-7389a2febcd9', 'volume_size': 1} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:21 devstack sudo[115036]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b 1073741824" returned: 0 in 0.895s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:21 devstack sudo[115041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b Jun 24 00:40:21 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:22 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" returned: 0 in 0.695s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.832s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-22841016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005aa91d-670f-4a10-b69f-415129e4aad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:20Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Creating volume 005aa91d-670f-4a10-b69f-415129e4aad3 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:22 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:22 devstack sudo[115044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 1073741824 Jun 24 00:40:22 devstack sudo[115044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045a20fa-e3ef-4231-8aa6-643b88dd7b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4efd6af-6992-4485-a9ad-f8fcab0c33fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:22 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Volume volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b (c937e1fa-0fb5-4d49-ac2a-082dfc13517b): created successfully Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4efd6af-6992-4485-a9ad-f8fcab0c33fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:22 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Flow 'volume_create_manager' (ee4ad3d9-a277-4374-82a1-980a3c23b050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9ef9ccdb-243e-42db-88fe-265d8a9bb083 tempest-VolumeDependencyTests-1408415002 None] Created volume successfully. Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Flow 'volume_create_manager' (317a8e0f-3a4c-40eb-9647-cab7ad6ce79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb3b457-5ae7-4501-85b1-fd34bd400254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb3b457-5ae7-4501-85b1-fd34bd400254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1a1357-392e-44bc-adb1-06142fcca6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cae74808a14819ae4c03042cc88eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:23Z,use_quota=True,user_id='4c2f47b4c0ec4a2ebd3d2b8c961f1f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b80e4d6a-aad1-4384-9a25-6bb1b0567fb7),volume_type_id=b80e4d6a-aad1-4384-9a25-6bb1b0567fb7)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fea749-a752-4d2b-82b6-f7263b27eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fea749-a752-4d2b-82b6-f7263b27eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f807afb0-d518-41b7-87e7-422ce145361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f807afb0-d518-41b7-87e7-422ce145361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec1a1357-392e-44bc-adb1-06142fcca6f7', 'volume_name': 'volume-ec1a1357-392e-44bc-adb1-06142fcca6f7', 'volume_size': 1, 'image_id': '2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fdc433d82913da1159796317f9e0415', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60cae74808a14819ae4c03042cc88eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df1feb98e48eca341b665c95b117d82cf7f12b072797b24b6957f3a7ceb9ae5df71c57b0efdfed0fa28b2a07ad9eb1b415ff0b1fe00ca02a72d9ae666181b153', 'id': '2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'created_at': datetime.datetime(2026, 6, 23, 22, 40, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 40, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48668733-a6fc-4889-a80c-765df351c8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48668733-a6fc-4889-a80c-765df351c8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d05a75-0358-4b32-804a-690c35a8aea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Volume ec1a1357-392e-44bc-adb1-06142fcca6f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec1a1357-392e-44bc-adb1-06142fcca6f7', 'volume_size': 1, 'image_id': '2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fdc433d82913da1159796317f9e0415', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60cae74808a14819ae4c03042cc88eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df1feb98e48eca341b665c95b117d82cf7f12b072797b24b6957f3a7ceb9ae5df71c57b0efdfed0fa28b2a07ad9eb1b415ff0b1fe00ca02a72d9ae666181b153', 'id': '2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'created_at': datetime.datetime(2026, 6, 23, 22, 40, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 40, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Trying to clone ec1a1357-392e-44bc-adb1-06142fcca6f7 from image 2ef6e19a-7808-454f-a6dc-d1ef2189389a at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:40:23 devstack sudo[115044]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:40:23 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Image download 0.00 MB at 0.00 MB/s Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 1073741824" returned: 0 in 0.884s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb5438-3de4-4559-888d-454a51894eb8]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:23 devstack sudo[115049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 Jun 24 00:40:23 devstack sudo[115049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:23 devstack sudo[115051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD Jun 24 00:40:23 devstack sudo[115051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:24 devstack sudo[115049]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3" returned: 0 in 0.669s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.305s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-241381699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099e21c4-943d-4028-992f-01e121a7f511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:20Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Creating volume 099e21c4-943d-4028-992f-01e121a7f511 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:24 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bfd3a4-2b1e-4047-810b-642fa8003a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005aa91d-670f-4a10-b69f-415129e4aad3', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:24 devstack sudo[115054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 1073741824 Jun 24 00:40:24 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c8bbc1-a1a1-43d4-87a1-a7b5d708ee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:24 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Volume volume-005aa91d-670f-4a10-b69f-415129e4aad3 (005aa91d-670f-4a10-b69f-415129e4aad3): created successfully Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c8bbc1-a1a1-43d4-87a1-a7b5d708ee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (0804ec78-11df-4607-a23a-57fb7aa0e009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:24 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eb7965af-6715-49c2-a76e-3c8e4df2c8eb tempest-CreateVolumesFromImageTest-1868610851 None] Created volume successfully. Jun 24 00:40:24 devstack sudo[115051]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD" returned: 0 in 0.883s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:24 devstack sudo[115058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD Jun 24 00:40:24 devstack sudo[115058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:25 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 1073741824" returned: 0 in 0.885s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:25 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 Jun 24 00:40:25 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:25 devstack sudo[115058]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD" returned: 1 in 0.731s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Temporary image 2ef6e19a-7808-454f-a6dc-d1ef2189389a is fetched for user 4c2f47b4c0ec4a2ebd3d2b8c961f1f08. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b16475-5026-4989-ab07-0aef92969426]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:25 devstack sudo[115068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD Jun 24 00:40:25 devstack sudo[115068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:25 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511" returned: 0 in 0.626s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.517s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356680158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42eac910-37af-4b4b-abb2-75d91d52bfa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:20Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Creating volume 42eac910-37af-4b4b-abb2-75d91d52bfa0 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:25 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:25 devstack sudo[115071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 1073741824 Jun 24 00:40:25 devstack sudo[115071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301aefd9-d7f9-49e3-b563-2db620ff05a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099e21c4-943d-4028-992f-01e121a7f511', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ba371b-c191-4441-8cba-b8625d4b348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:25 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume volume-099e21c4-943d-4028-992f-01e121a7f511 (099e21c4-943d-4028-992f-01e121a7f511): created successfully Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ba371b-c191-4441-8cba-b8625d4b348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:25 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (eee129ea-9671-41a9-a5b4-938e540553b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:25 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-128254b2-66d5-4918-a154-7547e37a8a33 tempest-CreateVolumesFromSnapshotTest-120681477 None] Created volume successfully. Jun 24 00:40:26 devstack sudo[115068]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD" returned: 0 in 0.727s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:26 devstack sudo[115075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD Jun 24 00:40:26 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:26 devstack sudo[115071]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 1073741824" returned: 0 in 0.804s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:26 devstack sudo[115081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 Jun 24 00:40:26 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:26 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD" returned: 1 in 0.773s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:40:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:27 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0" returned: 0 in 0.650s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.711s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2024690518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7286a4-796b-410d-97c5-742e0392a923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:20Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Creating volume 1f7286a4-796b-410d-97c5-742e0392a923 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:27 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5f0c61-8cf6-42fc-a2e8-6c83945d67c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42eac910-37af-4b4b-abb2-75d91d52bfa0', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:27 devstack sudo[115087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 1073741824 Jun 24 00:40:27 devstack sudo[115087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f3642b-80a4-47a4-b0f4-55bf5dcd0cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:27 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Volume volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 (42eac910-37af-4b4b-abb2-75d91d52bfa0): created successfully Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f3642b-80a4-47a4-b0f4-55bf5dcd0cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:27 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (3c592ee0-bbe9-484c-abff-a7a0831cc275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:27 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-873c5d26-7eaf-4feb-9339-cb05e33ea327 tempest-CreateVolumesFromImageTest-1868610851 None] Created volume successfully. Jun 24 00:40:28 devstack sudo[115087]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 1073741824" returned: 0 in 0.804s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:28 devstack sudo[115092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 Jun 24 00:40:28 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:28 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923" returned: 0 in 0.641s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.575s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1565212125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a47721e-006c-49b8-b3b5-7389a2febcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830798757264af1a1fd687c45bbf171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:21Z,use_quota=True,user_id='f2ca085159f54656adc88ef0474adaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Creating volume 1a47721e-006c-49b8-b3b5-7389a2febcd9 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:28 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:28 devstack sudo[115095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 1073741824 Jun 24 00:40:28 devstack sudo[115095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e628b0-0abe-4c2c-b8d4-fe7b91453492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7286a4-796b-410d-97c5-742e0392a923', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a447c1-3b46-4388-9e07-f0975ba794cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:28 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Volume volume-1f7286a4-796b-410d-97c5-742e0392a923 (1f7286a4-796b-410d-97c5-742e0392a923): created successfully Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a447c1-3b46-4388-9e07-f0975ba794cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:28 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (a4f94f19-76fb-4f89-85fc-1bfd74bc475d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:28 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9e68a354-9710-44e6-98f7-76465c46fb88 tempest-CreateVolumesFromImageTest-1868610851 None] Created volume successfully. Jun 24 00:40:29 devstack sudo[115095]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 1073741824" returned: 0 in 0.799s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:29 devstack sudo[115101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 Jun 24 00:40:29 devstack sudo[115101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:30 devstack sudo[115101]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9" returned: 0 in 0.639s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.540s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Creating offline snapshot 17e9178b-1064-4314-988d-4bb0cef3d523 of volume c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c44f3d-f9ff-46d2-a544-f586cd214cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a47721e-006c-49b8-b3b5-7389a2febcd9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f89e0c3-c89c-48bd-9501-794e8e22603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f62af4f-e806-4818-bc61-b80245d1ad3e]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:30 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Volume volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 (1a47721e-006c-49b8-b3b5-7389a2febcd9): created successfully Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f89e0c3-c89c-48bd-9501-794e8e22603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Flow 'volume_create_manager' (b13f6881-d3cd-49a7-93d9-3edb1dc8db89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:30 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-7901cace-1d68-43d2-9de0-d54a93ea2aff tempest-CreateVolumesFromImageTest-1868610851 None] Created volume successfully. Jun 24 00:40:30 devstack sudo[115104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b Jun 24 00:40:30 devstack sudo[115104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-1a47721e-006c-49b8-b3b5-7389a2febcd9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-1a47721e-006c-49b8-b3b5-7389a2febcd9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-quobyte-1a47721e-006c-49b8-b3b5-7389a2febcd9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-1a47721e-006c-49b8-b3b5-7389a2febcd9" acquired by "delete_volume" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c98d985-5f67-4e30-98f6-0528b6d089e5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:31 devstack sudo[115104]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" returned: 0 in 0.749s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:31 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 Jun 24 00:40:31 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:31 devstack sudo[115110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 1G Jun 24 00:40:31 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:31 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9" returned: 0 in 0.798s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:31 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9 Jun 24 00:40:31 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:31 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 1G" returned: 0 in 0.807s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:31 devstack sudo[115121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 Jun 24 00:40:31 devstack sudo[115121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:32 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1a47721e-006c-49b8-b3b5-7389a2febcd9" returned: 0 in 0.645s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-1a47721e-006c-49b8-b3b5-7389a2febcd9" released by "delete_volume" :: held 1.494s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Created reservations ['ff3a8994-d8bc-4d3b-b429-766f8cbcb3ad', '8d83450c-f0d1-4a3a-a342-bfe0df726523', '15e1b58a-fa0b-45ad-abe7-7920c69ac20e', 'ebc0bb4b-67df-4bac-a45e-8395c4895062'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:32 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:32 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:32 devstack sudo[115121]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523" returned: 0 in 0.733s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:32 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 is being set with open permissions: ugo+rw Jun 24 00:40:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:32 devstack sudo[115129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 Jun 24 00:40:32 devstack sudo[115129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-1f7286a4-796b-410d-97c5-742e0392a923-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-1f7286a4-796b-410d-97c5-742e0392a923-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-quobyte-1f7286a4-796b-410d-97c5-742e0392a923" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-1f7286a4-796b-410d-97c5-742e0392a923" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:33 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647a7b1-bf18-4be3-8c09-5a9dead069d6]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.673s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Deleted volume successfully. Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9555232d-b0aa-4a4a-978f-5da8716e5b7f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-1a47721e-006c-49b8-b3b5-7389a2febcd9-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:33 devstack sudo[115129]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523" returned: 0 in 0.686s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:33 devstack sudo[115133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 Jun 24 00:40:33 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:33 devstack sudo[115134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.info Jun 24 00:40:33 devstack sudo[115134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:34 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923" returned: 0 in 0.761s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:34 devstack sudo[115134]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.info" returned: 0 in 0.670s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:34 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.info is being set with open permissions: ugo+rw Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:34 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923 Jun 24 00:40:34 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:34 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.info Jun 24 00:40:34 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:34 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f7286a4-796b-410d-97c5-742e0392a923" returned: 0 in 0.634s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-1f7286a4-796b-410d-97c5-742e0392a923" released by "delete_volume" :: held 1.437s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:34 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.info" returned: 0 in 0.636s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.374s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.844s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1a1357-392e-44bc-adb1-06142fcca6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cae74808a14819ae4c03042cc88eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:23Z,use_quota=True,user_id='4c2f47b4c0ec4a2ebd3d2b8c961f1f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b80e4d6a-aad1-4384-9a25-6bb1b0567fb7),volume_type_id=b80e4d6a-aad1-4384-9a25-6bb1b0567fb7)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Creating volume ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:34 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:34 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 1073741824 Jun 24 00:40:34 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:34 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-1ace74c1-4970-4648-9438-ac03aced90e6 tempest-VolumeDependencyTests-1408415002 None] Create snapshot completed successfully Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Created reservations ['81e13d39-7f34-4dee-b46e-94aa0e4e2ae5', 'f9fa8dc1-fbfb-48a5-8458-91ef63c49384', 'f3160db3-e673-46c2-8748-24c4c0cf4f20', '21a1974b-b5c0-4583-b657-135862ce525c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:34 devstack sudo[115149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:34 devstack sudo[115149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-42eac910-37af-4b4b-abb2-75d91d52bfa0-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-42eac910-37af-4b4b-abb2-75d91d52bfa0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-quobyte-42eac910-37af-4b4b-abb2-75d91d52bfa0" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-42eac910-37af-4b4b-abb2-75d91d52bfa0" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb6818e-a8aa-4a2b-9ca3-f140a0d73caa]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:35 devstack sudo[115149]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.738s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:35 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Deleted volume successfully. Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2df9687-9a0a-4ccc-b858-423a5b2b3d57 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-1f7286a4-796b-410d-97c5-742e0392a923-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:35 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 Jun 24 00:40:35 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:35 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 1073741824" returned: 0 in 1.012s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:35 devstack sudo[115158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 Jun 24 00:40:35 devstack sudo[115158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Flow 'volume_create_manager' (f0b08448-1c6d-4ca3-a685-46eea6f7f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0c3cc1-a39d-4fa6-8e9a-259100dae9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0c3cc1-a39d-4fa6-8e9a-259100dae9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-131590131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e53972-7e2f-4be7-8cad-f0c0d729978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b9b2ed30dc4f97b3e37842bc319cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17e9178b-1064-4314-988d-4bb0cef3d523,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:36Z,use_quota=True,user_id='5835f15308eb4a6eaea12b42dc13f5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc241e1-6a02-46bc-a38f-4524dde26da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc241e1-6a02-46bc-a38f-4524dde26da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650025c0-973b-4865-a1ab-8babd12b482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650025c0-973b-4865-a1ab-8babd12b482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32e53972-7e2f-4be7-8cad-f0c0d729978d', 'volume_name': 'volume-32e53972-7e2f-4be7-8cad-f0c0d729978d', 'volume_size': 1, 'snapshot_id': '17e9178b-1064-4314-988d-4bb0cef3d523'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b9f328-8a2e-459a-b3fa-94f47a35e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b9f328-8a2e-459a-b3fa-94f47a35e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9725f0-a178-4eeb-a48b-23c885ba13a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:35 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Volume 32e53972-7e2f-4be7-8cad-f0c0d729978d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32e53972-7e2f-4be7-8cad-f0c0d729978d', 'volume_size': 1, 'snapshot_id': '17e9178b-1064-4314-988d-4bb0cef3d523'} Jun 24 00:40:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:36 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0" returned: 0 in 0.802s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:36 devstack sudo[115164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0 Jun 24 00:40:36 devstack sudo[115164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:36 devstack sudo[115158]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7" returned: 0 in 0.659s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.159s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Creating offline snapshot d90481a0-0677-46d8-8917-5289a2bc7d86 of volume 099e21c4-943d-4028-992f-01e121a7f511 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Attempting download of 2ef6e19a-7808-454f-a6dc-d1ef2189389a ((None, [{'url': 'file:///opt/stack/data/glance/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'metadata': {}}])) to volume ec1a1357-392e-44bc-adb1-06142fcca6f7. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c94fb9-09a2-41ad-a39e-fdccab9051e6]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7005e7-946f-4cb1-b120-84b2ab445b8d]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ef6e19a-7808-454f-a6dc-d1ef2189389a_zd3e1ff1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:36 devstack sudo[115167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 Jun 24 00:40:36 devstack sudo[115167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:36 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ef6e19a-7808-454f-a6dc-d1ef2189389a_zd3e1ff1 Jun 24 00:40:36 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:36 devstack sudo[115164]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-42eac910-37af-4b4b-abb2-75d91d52bfa0" returned: 0 in 0.637s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:36 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-42eac910-37af-4b4b-abb2-75d91d52bfa0" released by "delete_volume" :: held 1.500s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Created reservations ['e6ebfa4a-6196-4dea-9511-fe99f527637a', 'ec9d42ce-3b4a-46d6-97b5-628afb99a541', 'e1a1a852-47ed-406e-a31d-bf1dec4bed7c', '44da33ca-eb36-4f38-ab86-77a7da2204bb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:37 devstack sudo[115172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:37 devstack sudo[115172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:37 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ef6e19a-7808-454f-a6dc-d1ef2189389a_zd3e1ff1" returned: 0 in 0.771s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:37 devstack sudo[115167]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ef6e19a-7808-454f-a6dc-d1ef2189389a_zd3e1ff1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511" returned: 0 in 0.850s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:37 devstack sudo[115180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 1G Jun 24 00:40:37 devstack sudo[115180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:37 devstack sudo[115179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ef6e19a-7808-454f-a6dc-d1ef2189389a_zd3e1ff1 Jun 24 00:40:37 devstack sudo[115179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-005aa91d-670f-4a10-b69f-415129e4aad3-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-005aa91d-670f-4a10-b69f-415129e4aad3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-quobyte-005aa91d-670f-4a10-b69f-415129e4aad3" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-005aa91d-670f-4a10-b69f-415129e4aad3" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:37 devstack sudo[115172]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.674s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Deleted volume successfully. Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f0bf54-e0b4-49bf-a622-03d0b7742855]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-9c9edbca-9eaa-4212-be9f-364d1c256db8 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-42eac910-37af-4b4b-abb2-75d91d52bfa0-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:37 devstack sudo[115184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 Jun 24 00:40:37 devstack sudo[115184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:38 devstack sudo[115179]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ef6e19a-7808-454f-a6dc-d1ef2189389a_zd3e1ff1" returned: 1 in 0.823s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ef6e19a-7808-454f-a6dc-d1ef2189389a_zd3e1ff1' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb819fdf-853f-46fe-861b-417d7b445b6a]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:38 devstack sudo[115192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD Jun 24 00:40:38 devstack sudo[115192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:38 devstack sudo[115180]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 1G" returned: 0 in 0.926s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099e21c4-943d-4028-992f-01e121a7f511 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:38 devstack sudo[115194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099e21c4-943d-4028-992f-01e121a7f511 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 Jun 24 00:40:38 devstack sudo[115194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:38 devstack sudo[115184]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3" returned: 0 in 0.782s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:38 devstack sudo[115199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3 Jun 24 00:40:38 devstack sudo[115199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:38 devstack sudo[115192]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD" returned: 0 in 0.765s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:38 devstack sudo[115194]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099e21c4-943d-4028-992f-01e121a7f511 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86" returned: 0 in 0.704s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:38 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 is being set with open permissions: ugo+rw Jun 24 00:40:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:38 devstack sudo[115207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 Jun 24 00:40:38 devstack sudo[115207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:39 devstack sudo[115206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD Jun 24 00:40:39 devstack sudo[115206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:39 devstack sudo[115199]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-005aa91d-670f-4a10-b69f-415129e4aad3" returned: 0 in 0.682s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-005aa91d-670f-4a10-b69f-415129e4aad3" released by "delete_volume" :: held 1.525s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Created reservations ['7470c649-74c2-465f-8c75-742b0e4d5f86', 'e459a6da-3191-4866-b910-d1d80cb17662', '55a6003f-04fe-4ac4-ac83-db6e8a7aa4b8', 'd8ba0e03-c2f0-4b19-b472-b093e18cdbeb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:39 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:39 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:39 devstack sudo[115207]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86" returned: 0 in 0.665s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:39 devstack sudo[115206]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD" returned: 1 in 0.782s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] 2ef6e19a-7808-454f-a6dc-d1ef2189389a was raw, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:40:39 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.info Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:39 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:39 devstack sudo[115219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 Jun 24 00:40:39 devstack sudo[115219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:39 devstack sudo[115221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:39 devstack sudo[115221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-480560ad-7e6a-4418-953f-106206ce3582-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-480560ad-7e6a-4418-953f-106206ce3582-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "cinder-quobyte-480560ad-7e6a-4418-953f-106206ce3582" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-480560ad-7e6a-4418-953f-106206ce3582" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25f5065-e6f3-4104-a856-fb835f1db2db]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:40 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.877s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Deleted volume successfully. Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c1646784-1fc2-477a-b90c-8a8dec01bcd4 tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-005aa91d-670f-4a10-b69f-415129e4aad3-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:40 devstack sudo[115224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 Jun 24 00:40:40 devstack sudo[115224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:40 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.info" returned: 0 in 0.829s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:40 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.info is being set with open permissions: ugo+rw Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:40 devstack sudo[115230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.info Jun 24 00:40:40 devstack sudo[115230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:40 devstack sudo[115219]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7" returned: 0 in 0.907s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ef6e19a-7808-454f-a6dc-d1ef2189389a_hs9u7bt_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:40:40 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:40 devstack sudo[115221]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.875s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:40:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:40:40 devstack sudo[115233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 1G Jun 24 00:40:40 devstack sudo[115233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:41 devstack sudo[115224]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582" returned: 0 in 0.915s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:41 devstack sudo[115239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582 Jun 24 00:40:41 devstack sudo[115239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:41 devstack sudo[115230]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.info" returned: 0 in 0.660s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.765s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.278s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-quobyte-17e9178b-1064-4314-988d-4bb0cef3d523-32e53972-7e2f-4be7-8cad-f0c0d729978d" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-17e9178b-1064-4314-988d-4bb0cef3d523-32e53972-7e2f-4be7-8cad-f0c0d729978d" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Creating volume 32e53972-7e2f-4be7-8cad-f0c0d729978d from snapshot 17e9178b-1064-4314-988d-4bb0cef3d523 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-quobyte-32e53972-7e2f-4be7-8cad-f0c0d729978d" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:41 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fa9cb567-2322-461e-a34f-6e9459b769cf tempest-CreateVolumesFromSnapshotTest-120681477 None] Create snapshot completed successfully Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-32e53972-7e2f-4be7-8cad-f0c0d729978d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] snapshot: 17e9178b-1064-4314-988d-4bb0cef3d523, volume: 32e53972-7e2f-4be7-8cad-f0c0d729978d, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c2073-44c2-45c4-8f63-a25224914d69]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:41 devstack sudo[115233]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 1G" returned: 0 in 0.732s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc625c-af95-4a92-bd43-78c69224a63f]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:41 devstack sudo[115244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 Jun 24 00:40:41 devstack sudo[115244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:41 devstack sudo[115245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 Jun 24 00:40:41 devstack sudo[115245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:41 devstack sudo[115239]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-480560ad-7e6a-4418-953f-106206ce3582" returned: 0 in 0.686s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-quobyte-480560ad-7e6a-4418-953f-106206ce3582" released by "delete_volume" :: held 1.671s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Created reservations ['562e7e15-2e11-4aad-8acb-89f4fde41866', 'a19fee03-7dc0-4cd3-847f-9df8e0b12aa5', '3175a1a1-d568-43e1-a113-87653617d904', 'ca887584-c85c-499a-a937-ded1404de992'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:41 devstack sudo[115249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:41 devstack sudo[115249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:42 devstack sudo[115244]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523" returned: 0 in 0.929s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:40:42 devstack sudo[115245]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7" returned: 0 in 0.897s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5272888-0d7e-4f81-b09f-eceaf1aac6f8]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (64dc5108-e0d1-4fdd-8ff1-bb8427c011d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ad6f48-ecbb-44cf-bc61-3925272cca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:42 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 Jun 24 00:40:42 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:42 devstack sudo[115257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b Jun 24 00:40:42 devstack sudo[115257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ad6f48-ecbb-44cf-bc61-3925272cca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1333243286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb09dc36-0607-4b3c-96e7-02d0ebbd3d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:42Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff55495-8e51-46cb-8c86-204d491a622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff55495-8e51-46cb-8c86-204d491a622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8551a3f2-0613-434d-945e-dd5909336500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8551a3f2-0613-434d-945e-dd5909336500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb09dc36-0607-4b3c-96e7-02d0ebbd3d91', 'volume_name': 'volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a938ca66-c901-439d-a4d3-69718a3ce6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a938ca66-c901-439d-a4d3-69718a3ce6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d771a685-3ba8-4410-8115-847177dbbf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:42 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume eb09dc36-0607-4b3c-96e7-02d0ebbd3d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91', 'volume_size': 1} Jun 24 00:40:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (102e3ec8-d661-4d4d-ba51-4f256da211e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46342616-dd63-4a27-a007-4c116320da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46342616-dd63-4a27-a007-4c116320da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463254304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7083c5ab-55b5-4a4d-8216-59c77d109b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:43Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dfcdbf-0dc2-467a-a8e0-a99e751e7fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dfcdbf-0dc2-467a-a8e0-a99e751e7fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838cb411-499c-476f-bd30-99c18a4e43a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838cb411-499c-476f-bd30-99c18a4e43a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7083c5ab-55b5-4a4d-8216-59c77d109b85', 'volume_name': 'volume-7083c5ab-55b5-4a4d-8216-59c77d109b85', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02fae46-d966-4c5e-95e4-3ef052f04a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack sudo[115249]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02fae46-d966-4c5e-95e4-3ef052f04a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d562faac-16e2-4b63-a860-2ca554919851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume 7083c5ab-55b5-4a4d-8216-59c77d109b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7083c5ab-55b5-4a4d-8216-59c77d109b85', 'volume_size': 1} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.332s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Deleted volume successfully. Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-682381df-5929-4f84-89ab-8775ddfbee4f tempest-CreateVolumesFromImageTest-1868610851 None] Lock "cinder-480560ad-7e6a-4418-953f-106206ce3582-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:43 devstack sudo[115257]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" returned: 0 in 1.157s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:43 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7" returned: 1 in 1.204s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:40:43 devstack sudo[115273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Downloaded image 2ef6e19a-7808-454f-a6dc-d1ef2189389a ((None, [{'url': 'file:///opt/stack/data/glance/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'metadata': {}}])) to volume ec1a1357-392e-44bc-adb1-06142fcca6f7 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Temporary image 2ef6e19a-7808-454f-a6dc-d1ef2189389a for user 4c2f47b4c0ec4a2ebd3d2b8c961f1f08 is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Marking volume ec1a1357-392e-44bc-adb1-06142fcca6f7 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:40:43 devstack sudo[115273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Copying metadata from image 2ef6e19a-7808-454f-a6dc-d1ef2189389a to ec1a1357-392e-44bc-adb1-06142fcca6f7. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Creating volume glance metadata for volume ec1a1357-392e-44bc-adb1-06142fcca6f7 backed by image 2ef6e19a-7808-454f-a6dc-d1ef2189389a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3fdc433d82913da1159796317f9e0415', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d05a75-0358-4b32-804a-690c35a8aea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1a1357-392e-44bc-adb1-06142fcca6f7', 'volume_size': 1, 'image_id': '2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fdc433d82913da1159796317f9e0415', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60cae74808a14819ae4c03042cc88eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df1feb98e48eca341b665c95b117d82cf7f12b072797b24b6957f3a7ceb9ae5df71c57b0efdfed0fa28b2a07ad9eb1b415ff0b1fe00ca02a72d9ae666181b153', 'id': '2ef6e19a-7808-454f-a6dc-d1ef2189389a', 'created_at': datetime.datetime(2026, 6, 23, 22, 40, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 40, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ef6e19a-7808-454f-a6dc-d1ef2189389a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ab9e77-0619-434d-8a94-9d2655ec9d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Volume volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 (ec1a1357-392e-44bc-adb1-06142fcca6f7): created successfully Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ab9e77-0619-434d-8a94-9d2655ec9d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Flow 'volume_create_manager' (317a8e0f-3a4c-40eb-9647-cab7ad6ce79c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (54b5632e-4f09-43f3-9e94-c898dacdd28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ff6a32-fc9e-4276-bb02-0da72b5bded8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c004b811-5227-4ae1-ac51-d3cd1bfd4f96 tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Created volume successfully. Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ff6a32-fc9e-4276-bb02-0da72b5bded8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1836957347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7c1410-6b61-4510-8742-6f3cb5ea8078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:44Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7719e2-36d1-4689-8902-f51d7804a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7719e2-36d1-4689-8902-f51d7804a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a30295-1247-464c-b935-6dc2e32e516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a30295-1247-464c-b935-6dc2e32e516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7c1410-6b61-4510-8742-6f3cb5ea8078', 'volume_name': 'volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bddd0d-b93b-4ab6-b459-5b322e9eea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bddd0d-b93b-4ab6-b459-5b322e9eea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246b50ac-51d6-47ea-b3de-903842dd1b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume bd7c1410-6b61-4510-8742-6f3cb5ea8078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078', 'volume_size': 1} Jun 24 00:40:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (5c3ed747-27db-4b02-9b26-ef66233319d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172fa03b-9f62-4c2b-8982-43e849451185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172fa03b-9f62-4c2b-8982-43e849451185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1950966508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff18a21-73c5-4827-a2ba-29e639db8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:44Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787c92a4-01ca-42e8-8580-f715c6a4648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787c92a4-01ca-42e8-8580-f715c6a4648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd20b24-0c01-4634-a190-c35fbae88cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd20b24-0c01-4634-a190-c35fbae88cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff18a21-73c5-4827-a2ba-29e639db8c7c', 'volume_name': 'volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f87d94b-06c0-44b1-a5b2-201ccc68f8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f87d94b-06c0-44b1-a5b2-201ccc68f8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899f3ea4-01d9-4d88-aa88-653f90c480bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume 6ff18a21-73c5-4827-a2ba-29e639db8c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c', 'volume_size': 1} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Acquiring lock "cinder-ec1a1357-392e-44bc-adb1-06142fcca6f7-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (2252ab5f-7368-46da-84dd-f8daf8adebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd61cec6-9bcc-42ac-a6ce-eeb921a2721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "cinder-ec1a1357-392e-44bc-adb1-06142fcca6f7-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd61cec6-9bcc-42ac-a6ce-eeb921a2721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497036631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f476e81-aa8f-40e8-8284-c8ecc9bfe521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:45Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd6d955-2cb2-4f7e-969e-f78223222d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd6d955-2cb2-4f7e-969e-f78223222d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4592d7ac-6b51-4544-8a26-a8b46c75a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4592d7ac-6b51-4544-8a26-a8b46c75a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f476e81-aa8f-40e8-8284-c8ecc9bfe521', 'volume_name': 'volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be521ed-9427-48d4-ab95-e25262b913c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be521ed-9427-48d4-ab95-e25262b913c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb19685d-20ec-4339-8a01-375b6fc71399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:44 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume 1f476e81-aa8f-40e8-8284-c8ecc9bfe521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521', 'volume_size': 1} Jun 24 00:40:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Acquiring lock "cinder-quobyte-ec1a1357-392e-44bc-adb1-06142fcca6f7" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:45 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "cinder-quobyte-ec1a1357-392e-44bc-adb1-06142fcca6f7" acquired by "delete_volume" :: waited 0.050s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:45 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5334d9-f61f-4f37-a39c-ec7733d86ab5]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:45 devstack sudo[115286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 Jun 24 00:40:45 devstack sudo[115286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:47 devstack sudo[115286]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7" returned: 0 in 2.684s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:48 devstack sudo[115292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 Jun 24 00:40:48 devstack sudo[115292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:49 devstack sudo[115292]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7" returned: 1 in 1.332s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:40:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:49 devstack sudo[115297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7 Jun 24 00:40:49 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:49 devstack sudo[115273]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d" returned: 0 in 6.010s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:49 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40c2cd8-cc2a-45b7-ba5f-1e97b82cad08]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:49 devstack sudo[115299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b Jun 24 00:40:49 devstack sudo[115299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:49 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:49 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-ec1a1357-392e-44bc-adb1-06142fcca6f7" returned: 0 in 0.747s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "cinder-quobyte-ec1a1357-392e-44bc-adb1-06142fcca6f7" released by "delete_volume" :: held 4.962s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Created reservations ['2b5ebe0f-af02-4d67-ac04-cae1c3efa24e', '5385fe66-68fd-44ea-b158-87deb5a5574e', '4fd473b3-bc0f-4271-a042-cfc843760f74', '7e75262f-bb7c-4914-b24c-c80a3c4434dd'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:50 devstack sudo[115304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:50 devstack sudo[115304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:50 devstack sudo[115299]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" returned: 0 in 1.057s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:40:50 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Converted 1024.00 MB image at 170.32 MB/s Jun 24 00:40:50 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d is being set with open permissions: ugo+rw Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:50 devstack sudo[115307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d Jun 24 00:40:50 devstack sudo[115307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:50 devstack sudo[115304]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.710s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:40:50 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Deleted volume successfully. Jun 24 00:40:50 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-67a0c83c-b3c7-41ad-9308-08ad06b88ceb tempest-VolumeAndVolumeTypeFromImageTest-62926810 None] Lock "cinder-ec1a1357-392e-44bc-adb1-06142fcca6f7-delete_volume" released by "delete_volume" :: held 6.085s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:51 devstack sudo[115307]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d" returned: 0 in 0.761s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-32e53972-7e2f-4be7-8cad-f0c0d729978d" released by "_copy_volume_from_snapshot" :: held 10.057s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-17e9178b-1064-4314-988d-4bb0cef3d523-32e53972-7e2f-4be7-8cad-f0c0d729978d" released by "_create_volume_from_snapshot" :: held 10.104s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.141s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.756s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1333243286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb09dc36-0607-4b3c-96e7-02d0ebbd3d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:42Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Creating volume eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:51 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:51 devstack sudo[115311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 1073741824 Jun 24 00:40:51 devstack sudo[115311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9725f0-a178-4eeb-a48b-23c885ba13a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e53972-7e2f-4be7-8cad-f0c0d729978d', 'volume_size': 1, 'snapshot_id': '17e9178b-1064-4314-988d-4bb0cef3d523'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7806faf3-90d7-4ce8-a421-886440bcc5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:51 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Volume volume-32e53972-7e2f-4be7-8cad-f0c0d729978d (32e53972-7e2f-4be7-8cad-f0c0d729978d): created successfully Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7806faf3-90d7-4ce8-a421-886440bcc5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:51 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Flow 'volume_create_manager' (f0b08448-1c6d-4ca3-a685-46eea6f7f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:51 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-f8e450d0-8445-487b-b2d0-400c2bf76bf9 tempest-VolumeDependencyTests-1408415002 None] Created volume successfully. Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-17e9178b-1064-4314-988d-4bb0cef3d523-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-17e9178b-1064-4314-988d-4bb0cef3d523-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-quobyte-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:52 devstack sudo[115311]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 1073741824" returned: 0 in 1.093s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" acquired by "delete_snapshot" :: waited 0.056s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-quobyte-17e9178b-1064-4314-988d-4bb0cef3d523" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-17e9178b-1064-4314-988d-4bb0cef3d523" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Deleting offline snapshot 17e9178b-1064-4314-988d-4bb0cef3d523 of volume c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] snapshot_file for this snap is: volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abc4cc4-b4f6-48fb-b171-bc51514cd12b]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:52 devstack sudo[115318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 Jun 24 00:40:52 devstack sudo[115318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:52 devstack sudo[115319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 Jun 24 00:40:52 devstack sudo[115319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:53 devstack sudo[115318]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91" returned: 0 in 0.738s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.972s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463254304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7083c5ab-55b5-4a4d-8216-59c77d109b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:43Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Creating volume 7083c5ab-55b5-4a4d-8216-59c77d109b85 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:53 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d771a685-3ba8-4410-8115-847177dbbf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8be1eb-8a69-4e30-bb97-0f23342b70df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:53 devstack sudo[115323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 1073741824 Jun 24 00:40:53 devstack sudo[115323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 (eb09dc36-0607-4b3c-96e7-02d0ebbd3d91): created successfully Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8be1eb-8a69-4e30-bb97-0f23342b70df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (64dc5108-e0d1-4fdd-8ff1-bb8427c011d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:53 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ad44d88f-2613-4f76-b205-3c73d52037e7 tempest-CreateVolumesFromSnapshotTest-120681477 None] Created volume successfully. Jun 24 00:40:53 devstack sudo[115319]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523" returned: 0 in 1.152s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aad4042-6956-4d5b-88d8-e0cd07841c8a]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:54 devstack sudo[115329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b Jun 24 00:40:54 devstack sudo[115329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:54 devstack sudo[115323]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 1073741824" returned: 0 in 1.334s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:54 devstack sudo[115335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 Jun 24 00:40:54 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:55 devstack sudo[115329]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" returned: 0 in 1.266s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:55 devstack sudo[115340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 Jun 24 00:40:55 devstack sudo[115340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:55 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85" returned: 0 in 0.861s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.269s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.704s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1836957347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7c1410-6b61-4510-8742-6f3cb5ea8078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:44Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Creating volume bd7c1410-6b61-4510-8742-6f3cb5ea8078 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:55 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:55 devstack sudo[115343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 1073741824 Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d562faac-16e2-4b63-a860-2ca554919851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7083c5ab-55b5-4a4d-8216-59c77d109b85', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:55 devstack sudo[115343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d89f43-40f1-474b-9616-a3a9256d57c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 (7083c5ab-55b5-4a4d-8216-59c77d109b85): created successfully Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d89f43-40f1-474b-9616-a3a9256d57c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (102e3ec8-d661-4d4d-ba51-4f256da211e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-91798496-f7d7-4ef0-93d4-0077d9014ef3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Created volume successfully. Jun 24 00:40:56 devstack sudo[115340]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523" returned: 0 in 1.189s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:56 devstack sudo[115348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523 Jun 24 00:40:56 devstack sudo[115348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:56 devstack sudo[115343]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 1073741824" returned: 0 in 1.336s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:57 devstack sudo[115355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 Jun 24 00:40:57 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:57 devstack sudo[115348]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b.17e9178b-1064-4314-988d-4bb0cef3d523" returned: 0 in 1.043s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-17e9178b-1064-4314-988d-4bb0cef3d523" released by "_delete_snapshot" :: held 4.845s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" released by "delete_snapshot" :: held 4.896s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (b21cfc56-237d-4773-853c-4732f871b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc84281-a69f-47af-8d2e-07bb60096456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc84281-a69f-47af-8d2e-07bb60096456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1223841947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e95647-1032-425b-9dba-5f2c387e4cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:57Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d0ac74-f43e-4c16-a017-f9f6163d4d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d0ac74-f43e-4c16-a017-f9f6163d4d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcaf523-6c06-442d-a48d-56ebc11416b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcaf523-6c06-442d-a48d-56ebc11416b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e95647-1032-425b-9dba-5f2c387e4cca', 'volume_name': 'volume-b3e95647-1032-425b-9dba-5f2c387e4cca', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9f2e16-970a-4241-99b7-664db939c85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9f2e16-970a-4241-99b7-664db939c85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b083fd8e-e798-4176-a7a7-6b17ee6a79f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume b3e95647-1032-425b-9dba-5f2c387e4cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e95647-1032-425b-9dba-5f2c387e4cca', 'volume_size': 1} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Created reservations ['3635800a-dcfd-4bcc-9dcd-53b2db491799', '19056fa9-e3d8-4b0d-b603-da61a24e109f', '311423e5-e661-407a-9ed6-56ffdc01579e', '0d9b65c5-256d-4eab-9772-85a93a326808'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Delete snapshot completed successfully. Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4c174332-a9e4-4a6c-be18-c60e5e9609aa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-17e9178b-1064-4314-988d-4bb0cef3d523-delete_snapshot" released by "delete_snapshot" :: held 5.308s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:57 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078" returned: 0 in 0.836s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.434s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1950966508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff18a21-73c5-4827-a2ba-29e639db8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:44Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Creating volume 6ff18a21-73c5-4827-a2ba-29e639db8c7c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:57 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-c937e1fa-0fb5-4d49-ac2a-082dfc13517b-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246b50ac-51d6-47ea-b3de-903842dd1b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:57 devstack sudo[115359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c 1073741824 Jun 24 00:40:57 devstack sudo[115359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67362ac-2bd3-4c01-ae12-cc8aa98fdc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:57 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 (bd7c1410-6b61-4510-8742-6f3cb5ea8078): created successfully Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67362ac-2bd3-4c01-ae12-cc8aa98fdc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (54b5632e-4f09-43f3-9e94-c898dacdd28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-c937e1fa-0fb5-4d49-ac2a-082dfc13517b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:57 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b696d5ac-b669-4a73-9b12-d6b14a52a52e tempest-CreateVolumesFromSnapshotTest-120681477 None] Created volume successfully. Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-quobyte-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:40:57 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:40:58 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ee19c-760a-4cdb-87cd-07c8bf503114]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:58 devstack sudo[115361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b Jun 24 00:40:58 devstack sudo[115361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:58 devstack sudo[115361]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" returned: 0 in 0.960s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:58 devstack sudo[115359]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c 1073741824" returned: 0 in 1.178s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:59 devstack sudo[115370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b Jun 24 00:40:59 devstack sudo[115370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:59 devstack sudo[115372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c Jun 24 00:40:59 devstack sudo[115372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:59 devstack sudo[115370]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" returned: 0 in 0.672s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-c937e1fa-0fb5-4d49-ac2a-082dfc13517b" released by "delete_volume" :: held 1.703s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Created reservations ['0531d761-1a1b-4f06-87ce-ad2ac2073ea3', 'aa7212c4-862c-466b-8ec5-87645f68a5cb', 'ab6f8cc7-9614-419e-9220-a968ac6a5197', '216fc80e-6776-43ab-bd62-afef6697920d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:40:59 devstack sudo[115372]: pam_unix(sudo:session): session closed for user root Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c" returned: 0 in 0.719s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.820s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497036631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f476e81-aa8f-40e8-8284-c8ecc9bfe521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c75cbcd481340f6bfaa02d281793daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:45Z,use_quota=True,user_id='55be8a6b84b946f598470484958a1f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Creating volume 1f476e81-aa8f-40e8-8284-c8ecc9bfe521 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:40:59 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:59 devstack sudo[115376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 1073741824 Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899f3ea4-01d9-4d88-aa88-653f90c480bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:59 devstack sudo[115376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25c5d41-ef6b-4ae5-b039-824ede3c7d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:40:59 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c (6ff18a21-73c5-4827-a2ba-29e639db8c7c): created successfully Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25c5d41-ef6b-4ae5-b039-824ede3c7d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (5c3ed747-27db-4b02-9b26-ef66233319d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:40:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-3afdd0d2-37f2-46e7-a28e-4116ca118dac tempest-CreateVolumesFromSnapshotTest-120681477 None] Created volume successfully. Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:40:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:40:59 devstack sudo[115378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:40:59 devstack sudo[115378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-32e53972-7e2f-4be7-8cad-f0c0d729978d-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-32e53972-7e2f-4be7-8cad-f0c0d729978d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "cinder-quobyte-32e53972-7e2f-4be7-8cad-f0c0d729978d" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-32e53972-7e2f-4be7-8cad-f0c0d729978d" acquired by "delete_volume" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f6821-1726-4e33-82d5-d42b10a857aa]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:00 devstack sudo[115380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d Jun 24 00:41:00 devstack sudo[115380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:00 devstack sudo[115378]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.846s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:00 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Deleted volume successfully. Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-ed267a41-c6e8-4a55-8d83-238c47195748 tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-c937e1fa-0fb5-4d49-ac2a-082dfc13517b-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:00 devstack sudo[115376]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 1073741824" returned: 0 in 1.135s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:01 devstack sudo[115387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 Jun 24 00:41:01 devstack sudo[115387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:01 devstack sudo[115380]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d" returned: 0 in 1.074s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:01 devstack sudo[115393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d Jun 24 00:41:01 devstack sudo[115393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:01 devstack sudo[115387]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521" returned: 0 in 0.702s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.158s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1223841947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e95647-1032-425b-9dba-5f2c387e4cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:40:57Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Creating volume b3e95647-1032-425b-9dba-5f2c387e4cca {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:01 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb19685d-20ec-4339-8a01-375b6fc71399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:01 devstack sudo[115396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca 1073741824 Jun 24 00:41:01 devstack sudo[115396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e64ab2d-6c01-4ee2-a575-c282beabed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:01 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Volume volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 (1f476e81-aa8f-40e8-8284-c8ecc9bfe521): created successfully Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e64ab2d-6c01-4ee2-a575-c282beabed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:01 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Flow 'volume_create_manager' (2252ab5f-7368-46da-84dd-f8daf8adebd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:01 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c0f85898-dbe8-45e7-a2fc-4e63f2454df5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Created volume successfully. Jun 24 00:41:02 devstack sudo[115393]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-32e53972-7e2f-4be7-8cad-f0c0d729978d" returned: 0 in 0.715s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-quobyte-32e53972-7e2f-4be7-8cad-f0c0d729978d" released by "delete_volume" :: held 1.854s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Created reservations ['58c10392-30d0-4781-b402-45b017daa36c', '2f44a87a-12a5-4e9e-9f14-97330901267a', '02a464e2-f865-40c5-aaef-82daf03de678', '904c929b-3d2b-4e75-a174-6831b565e208'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:02 devstack sudo[115400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:02 devstack sudo[115400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:02 devstack sudo[115396]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca 1073741824" returned: 0 in 1.083s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:02 devstack sudo[115406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca Jun 24 00:41:02 devstack sudo[115406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-1f476e81-aa8f-40e8-8284-c8ecc9bfe521-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-1f476e81-aa8f-40e8-8284-c8ecc9bfe521-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-quobyte-1f476e81-aa8f-40e8-8284-c8ecc9bfe521" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-1f476e81-aa8f-40e8-8284-c8ecc9bfe521" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa87b6b-ad0d-47f2-99a0-e95b27bff1dd]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:03 devstack sudo[115400]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.924s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Deleted volume successfully. Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-c4a66fd2-71d7-4af5-8767-51446b7614fa tempest-VolumeDependencyTests-1408415002 None] Lock "cinder-32e53972-7e2f-4be7-8cad-f0c0d729978d-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:03 devstack sudo[115409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 Jun 24 00:41:03 devstack sudo[115409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:03 devstack sudo[115406]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca" returned: 0 in 0.955s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b083fd8e-e798-4176-a7a7-6b17ee6a79f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e95647-1032-425b-9dba-5f2c387e4cca', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c36cef8-b824-43a1-ac55-8fa6169c88e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:03 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume volume-b3e95647-1032-425b-9dba-5f2c387e4cca (b3e95647-1032-425b-9dba-5f2c387e4cca): created successfully Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c36cef8-b824-43a1-ac55-8fa6169c88e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:03 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (b21cfc56-237d-4773-853c-4732f871b21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:03 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4a6fc577-3c9f-4de9-b83c-0a469c1db1dd tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created volume successfully. Jun 24 00:41:04 devstack sudo[115409]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521" returned: 0 in 1.127s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:04 devstack sudo[115415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521 Jun 24 00:41:04 devstack sudo[115415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:04 devstack sudo[115415]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-1f476e81-aa8f-40e8-8284-c8ecc9bfe521" returned: 0 in 0.760s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-1f476e81-aa8f-40e8-8284-c8ecc9bfe521" released by "delete_volume" :: held 1.947s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Created reservations ['ceb260ae-2430-4c85-8386-fa45702ae50c', '50af82b2-705c-429a-8fa3-c41614e2e8a7', '39544f41-d2e8-407c-a59c-065dd691efd8', '89e8fce6-8cb4-493d-a44d-d4d3031ac98c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:05 devstack sudo[115418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:05 devstack sudo[115418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-6ff18a21-73c5-4827-a2ba-29e639db8c7c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-6ff18a21-73c5-4827-a2ba-29e639db8c7c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-quobyte-6ff18a21-73c5-4827-a2ba-29e639db8c7c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-6ff18a21-73c5-4827-a2ba-29e639db8c7c" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8070a09c-3a8d-4847-ae09-e1eedbc33722]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (7c2e98aa-183b-4852-9ec5-7385e1948d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:05 devstack sudo[115420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c Jun 24 00:41:05 devstack sudo[115420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d055ca6-1589-4898-8271-849121ba26ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d055ca6-1589-4898-8271-849121ba26ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944388503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc07017d-a48b-42ef-9f4a-08ab26ec7651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:05Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5ecae4-b99a-4c76-af65-f0ad29f0cbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5ecae4-b99a-4c76-af65-f0ad29f0cbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7895aaa-9e43-48f0-a0ae-e52a87280e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7895aaa-9e43-48f0-a0ae-e52a87280e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc07017d-a48b-42ef-9f4a-08ab26ec7651', 'volume_name': 'volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151e1e86-76b3-4c2c-8fa1-219d8f46d516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151e1e86-76b3-4c2c-8fa1-219d8f46d516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d6650a-21e4-4bed-be07-22a755a1c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:05 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume cc07017d-a48b-42ef-9f4a-08ab26ec7651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651', 'volume_size': 1} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-944388503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc07017d-a48b-42ef-9f4a-08ab26ec7651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:05Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Creating volume cc07017d-a48b-42ef-9f4a-08ab26ec7651 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:05 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:05 devstack sudo[115422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 1073741824 Jun 24 00:41:05 devstack sudo[115422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (69bc97e0-e28e-43d3-9534-b136bcdc8053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88fa940-4cc8-4390-8cbe-5f4b712c35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88fa940-4cc8-4390-8cbe-5f4b712c35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030193933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b504c07d-313a-48aa-8e49-8559ab8da086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:06Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b3c6c7-e999-4a1c-bceb-b543e176d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b3c6c7-e999-4a1c-bceb-b543e176d876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:06 devstack sudo[115418]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff7d990-9d16-4c60-999e-2de1b93f4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff7d990-9d16-4c60-999e-2de1b93f4de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b504c07d-313a-48aa-8e49-8559ab8da086', 'volume_name': 'volume-b504c07d-313a-48aa-8e49-8559ab8da086', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15913a07-36bf-4dab-adf3-db51dd3717c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15913a07-36bf-4dab-adf3-db51dd3717c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6582335b-f61a-48e3-a975-92e939e9478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:06 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume b504c07d-313a-48aa-8e49-8559ab8da086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b504c07d-313a-48aa-8e49-8559ab8da086', 'volume_size': 1} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.383s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:06 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Deleted volume successfully. Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-447db6df-5790-4714-b0c1-3071f4cbb79e tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-1f476e81-aa8f-40e8-8284-c8ecc9bfe521-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:06 devstack sudo[115420]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c" returned: 0 in 1.479s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:06 devstack sudo[115434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c Jun 24 00:41:06 devstack sudo[115434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:06 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (bb7a763c-685e-4d7b-8eea-a0c0a0f20e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4bd627-ba46-4d4e-b0fd-b42abfbee42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4bd627-ba46-4d4e-b0fd-b42abfbee42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586277461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18916ad5-bc65-45ab-a755-f21a507e9cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:07Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f102046-f900-4eef-8860-af7aefcc03f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f102046-f900-4eef-8860-af7aefcc03f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b905d683-3151-4e85-806f-4f93c71adcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b905d683-3151-4e85-806f-4f93c71adcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18916ad5-bc65-45ab-a755-f21a507e9cf9', 'volume_name': 'volume-18916ad5-bc65-45ab-a755-f21a507e9cf9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448e84c3-6377-4716-9ed9-fcab3fcb4039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448e84c3-6377-4716-9ed9-fcab3fcb4039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286a9bd2-fab3-4d4e-b2b4-f0ea6e64ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume 18916ad5-bc65-45ab-a755-f21a507e9cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18916ad5-bc65-45ab-a755-f21a507e9cf9', 'volume_size': 1} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:07 devstack sudo[115422]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 1073741824" returned: 0 in 1.498s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:07 devstack sudo[115436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 Jun 24 00:41:07 devstack sudo[115436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (c79a5b61-320d-4798-ac4a-cba7b1651c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afe63cd-cf78-4733-9179-86df4ecfc9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afe63cd-cf78-4733-9179-86df4ecfc9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502006714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6c28c6-3976-422f-b454-362b88c9dc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:07Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8756c47-72aa-4b0b-8097-c3dcdc14940d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8756c47-72aa-4b0b-8097-c3dcdc14940d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2f974e-6dac-4185-9935-42b54af38bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2f974e-6dac-4185-9935-42b54af38bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6c28c6-3976-422f-b454-362b88c9dc06', 'volume_name': 'volume-5a6c28c6-3976-422f-b454-362b88c9dc06', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2be195-0dda-484c-85ff-861e316147a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2be195-0dda-484c-85ff-861e316147a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc2f7cc-3c36-4195-a900-f29532e4c38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:07 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume 5a6c28c6-3976-422f-b454-362b88c9dc06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6c28c6-3976-422f-b454-362b88c9dc06', 'volume_size': 1} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:07 devstack sudo[115434]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-6ff18a21-73c5-4827-a2ba-29e639db8c7c" returned: 0 in 0.991s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-6ff18a21-73c5-4827-a2ba-29e639db8c7c" released by "delete_volume" :: held 2.554s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (dc49f1d9-d723-4d6f-961b-cc32ccf8e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:07 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149f2c88-eb70-42cf-8100-1c35e476b0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149f2c88-eb70-42cf-8100-1c35e476b0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672698571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda7be4a-0477-4d7a-a492-d23fffc0acd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:08Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1610dd-40fb-47fb-820f-7979c5457f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1610dd-40fb-47fb-820f-7979c5457f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420452c2-5c08-41fc-af03-5698b341ad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420452c2-5c08-41fc-af03-5698b341ad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda7be4a-0477-4d7a-a492-d23fffc0acd2', 'volume_name': 'volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab79356-aec0-4404-83af-79e298b38b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab79356-aec0-4404-83af-79e298b38b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef3bb8a-ec74-4fcb-9720-a0840297f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume dda7be4a-0477-4d7a-a492-d23fffc0acd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2', 'volume_size': 1} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Created reservations ['d712a097-6654-4a95-8fb5-c99983a87c3f', 'b82a76b3-6df8-4e5c-b692-3845c8b56d2b', '4af3be7b-21f2-404c-be1b-900870abbbaa', 'b5c79452-885c-46ea-a37a-fd51356b2f2c'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:08 devstack sudo[115436]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651" returned: 0 in 0.928s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] <== create_volume: return (2491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030193933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b504c07d-313a-48aa-8e49-8559ab8da086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:06Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Creating volume b504c07d-313a-48aa-8e49-8559ab8da086 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:08 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d6650a-21e4-4bed-be07-22a755a1c012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:08 devstack sudo[115440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 1073741824 Jun 24 00:41:08 devstack sudo[115440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b96c563-9d8d-4275-b6f1-2592741aa3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:08 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 (cc07017d-a48b-42ef-9f4a-08ab26ec7651): created successfully Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b96c563-9d8d-4275-b6f1-2592741aa3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (7c2e98aa-183b-4852-9ec5-7385e1948d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:08 devstack sudo[115442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:08 devstack sudo[115442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:08 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-87f4e1b6-90f2-4504-95f7-b042058ed8fb tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created volume successfully. Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-bd7c1410-6b61-4510-8742-6f3cb5ea8078-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-bd7c1410-6b61-4510-8742-6f3cb5ea8078-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-quobyte-bd7c1410-6b61-4510-8742-6f3cb5ea8078" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:08 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-bd7c1410-6b61-4510-8742-6f3cb5ea8078" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[be55a05f-29c6-4ace-864f-f7dbbfb0b9b2]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:09 devstack sudo[115442]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.856s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:09 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Deleted volume successfully. Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-de330ec7-87bd-4b12-833f-54f1bea00e23 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-6ff18a21-73c5-4827-a2ba-29e639db8c7c-delete_volume" released by "delete_volume" :: held 3.833s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:09 devstack sudo[115449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 Jun 24 00:41:09 devstack sudo[115449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:09 devstack sudo[115440]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 1073741824" returned: 0 in 1.081s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:09 devstack sudo[115451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 Jun 24 00:41:09 devstack sudo[115451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:09 devstack sudo[115449]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078" returned: 0 in 0.905s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:09 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:09 devstack sudo[115458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078 Jun 24 00:41:09 devstack sudo[115458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:10 devstack sudo[115451]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086" returned: 0 in 0.726s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.875s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586277461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18916ad5-bc65-45ab-a755-f21a507e9cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:07Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Creating volume 18916ad5-bc65-45ab-a755-f21a507e9cf9 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:10 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6582335b-f61a-48e3-a975-92e939e9478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b504c07d-313a-48aa-8e49-8559ab8da086', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:10 devstack sudo[115460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 1073741824 Jun 24 00:41:10 devstack sudo[115460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb6a647-38e2-4ac9-8b3d-d0dcd31dc21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:10 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume volume-b504c07d-313a-48aa-8e49-8559ab8da086 (b504c07d-313a-48aa-8e49-8559ab8da086): created successfully Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb6a647-38e2-4ac9-8b3d-d0dcd31dc21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (69bc97e0-e28e-43d3-9534-b136bcdc8053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:10 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fe9d799f-33a6-4ba5-9267-bf96c611ef0b tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created volume successfully. Jun 24 00:41:10 devstack sudo[115458]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-bd7c1410-6b61-4510-8742-6f3cb5ea8078" returned: 0 in 0.695s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-bd7c1410-6b61-4510-8742-6f3cb5ea8078" released by "delete_volume" :: held 1.668s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Created reservations ['b90149f7-3211-4ece-ba4f-e652efd780f0', 'c7bd56f5-2cb0-4342-9a27-6b1ac8b47113', '211093f1-9011-498e-8f88-38e90848ee2a', '4daf68c2-5b63-4f13-9d05-8bc3b93633cc'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:10 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:10 devstack sudo[115466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:10 devstack sudo[115466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:11 devstack sudo[115460]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 1073741824" returned: 0 in 1.024s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-7083c5ab-55b5-4a4d-8216-59c77d109b85-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-7083c5ab-55b5-4a4d-8216-59c77d109b85-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:11 devstack sudo[115468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 Jun 24 00:41:11 devstack sudo[115468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-quobyte-7083c5ab-55b5-4a4d-8216-59c77d109b85" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-7083c5ab-55b5-4a4d-8216-59c77d109b85" acquired by "delete_volume" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac231ab-3783-4eb8-b8da-2f8fc41be3c1]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:11 devstack sudo[115470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 Jun 24 00:41:11 devstack sudo[115470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:11 devstack sudo[115466]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.821s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:11 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Deleted volume successfully. Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a1eaae4f-cb45-4833-8a8c-15176facc10c tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-bd7c1410-6b61-4510-8742-6f3cb5ea8078-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:11 devstack sudo[115468]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9" returned: 0 in 0.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.415s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502006714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6c28c6-3976-422f-b454-362b88c9dc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:07Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Creating volume 5a6c28c6-3976-422f-b454-362b88c9dc06 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:11 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:11 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:12 devstack sudo[115475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 1073741824 Jun 24 00:41:12 devstack sudo[115475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286a9bd2-fab3-4d4e-b2b4-f0ea6e64ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18916ad5-bc65-45ab-a755-f21a507e9cf9', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba14825-0630-4555-83e5-c533df2c1417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:12 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 (18916ad5-bc65-45ab-a755-f21a507e9cf9): created successfully Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba14825-0630-4555-83e5-c533df2c1417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (bb7a763c-685e-4d7b-8eea-a0c0a0f20e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:12 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b05da2dd-aa3e-4bdf-9cd2-61337a7030af tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created volume successfully. Jun 24 00:41:12 devstack sudo[115470]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85" returned: 0 in 0.933s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:12 devstack sudo[115481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85 Jun 24 00:41:12 devstack sudo[115481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:12 devstack sudo[115475]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 1073741824" returned: 0 in 0.904s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:12 devstack sudo[115481]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:12 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-7083c5ab-55b5-4a4d-8216-59c77d109b85" returned: 0 in 0.696s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:12 devstack sudo[115488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 Jun 24 00:41:12 devstack sudo[115488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-7083c5ab-55b5-4a4d-8216-59c77d109b85" released by "delete_volume" :: held 1.696s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Created reservations ['643d82c6-70d8-482e-85b7-0d33655880cb', 'd99af41f-f90d-4834-8f68-ff247ce51bfb', '5edf7ad6-923d-47ae-88b9-a63cf6a4dc67', 'ce65d6a6-4c0a-4de3-9dfc-147a724156fa'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:13 devstack sudo[115490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:13 devstack sudo[115490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-quobyte-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91" acquired by "delete_volume" :: waited 0.056s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:13 devstack sudo[115488]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06" returned: 0 in 0.915s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[43768f4d-4217-4341-88e4-169df8e2fe1f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.816s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672698571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda7be4a-0477-4d7a-a492-d23fffc0acd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb878fd1794479bb3ad57e6a58cd30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:08Z,use_quota=True,user_id='1b01b2206e0f478d86d88f56f70ec07a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Creating volume dda7be4a-0477-4d7a-a492-d23fffc0acd2 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:13 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:13 devstack sudo[115527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 1073741824 Jun 24 00:41:13 devstack sudo[115527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:13 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc2f7cc-3c36-4195-a900-f29532e4c38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6c28c6-3976-422f-b454-362b88c9dc06', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ef2238-5dd1-4403-8fbd-bf3e2d30a2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:14 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume volume-5a6c28c6-3976-422f-b454-362b88c9dc06 (5a6c28c6-3976-422f-b454-362b88c9dc06): created successfully Jun 24 00:41:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ef2238-5dd1-4403-8fbd-bf3e2d30a2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:14 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (c79a5b61-320d-4798-ac4a-cba7b1651c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-66c56396-8de4-40d3-89b2-8c25bc6de228 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created volume successfully. Jun 24 00:41:14 devstack sudo[115528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 Jun 24 00:41:14 devstack sudo[115528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:14 devstack sudo[115490]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.279s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:14 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:14 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Deleted volume successfully. Jun 24 00:41:14 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4dacd7b3-c31e-4b9a-8785-19947f78a8f5 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-7083c5ab-55b5-4a4d-8216-59c77d109b85-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:14 devstack sudo[115527]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:14 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 1073741824" returned: 0 in 1.095s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:15 devstack sudo[115528]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91" returned: 0 in 1.116s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:15 devstack sudo[115542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91 Jun 24 00:41:15 devstack sudo[115542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:15 devstack sudo[115543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 Jun 24 00:41:15 devstack sudo[115543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Flow 'volume_create_manager' (f2e9c78c-8682-46c0-9c79-716a7d72e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eccb4bf-2f07-4a06-82b3-a6ad8cd610cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eccb4bf-2f07-4a06-82b3-a6ad8cd610cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-147058619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76633bde-7217-4610-b2c3-f87b202fe362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c2f1be3cd149fbbe5c6f6de13c0246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:15Z,use_quota=True,user_id='1f5e4e832b5748e581e5a8f208105075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4207a72c-c84e-4eeb-a543-4a98da1ca848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4207a72c-c84e-4eeb-a543-4a98da1ca848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598099a3-ad6a-42ee-8470-c314e349539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598099a3-ad6a-42ee-8470-c314e349539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76633bde-7217-4610-b2c3-f87b202fe362', 'volume_name': 'volume-76633bde-7217-4610-b2c3-f87b202fe362', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76af87f-a4ca-46a7-8052-a3fd8b27b59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76af87f-a4ca-46a7-8052-a3fd8b27b59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb10f5ea-aa25-4678-88f1-bd0155a441c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Volume 76633bde-7217-4610-b2c3-f87b202fe362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76633bde-7217-4610-b2c3-f87b202fe362', 'volume_size': 1} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:15 devstack sudo[115543]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2" returned: 0 in 0.642s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.207s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-147058619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76633bde-7217-4610-b2c3-f87b202fe362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c2f1be3cd149fbbe5c6f6de13c0246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:15Z,use_quota=True,user_id='1f5e4e832b5748e581e5a8f208105075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Creating volume 76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:15 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:15 devstack sudo[115542]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91" returned: 0 in 0.684s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:15 devstack sudo[115548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 1073741824 Jun 24 00:41:15 devstack sudo[115548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef3bb8a-ec74-4fcb-9720-a0840297f839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c8e224-38a8-4a3f-9b7c-ba32fd5a6013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91" released by "delete_volume" :: held 1.932s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:15 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Volume volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 (dda7be4a-0477-4d7a-a492-d23fffc0acd2): created successfully Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c8e224-38a8-4a3f-9b7c-ba32fd5a6013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Flow 'volume_create_manager' (dc49f1d9-d723-4d6f-961b-cc32ccf8e444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:15 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-bb13ec84-98dc-4158-9c61-17ae1c66987d tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created volume successfully. Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Created reservations ['9bdc9d6c-fdb7-48d8-873c-a7d1d02a2ee0', '20cd3765-c612-45f2-842b-eb0dad8ce9a7', 'bde6e8a9-4d8f-4607-8e5a-6fde8f9f08ad', '05a9f189-30ad-4239-a7c9-0632101399f6'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:15 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:15 devstack sudo[115550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:15 devstack sudo[115550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:16 devstack sudo[115548]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:16 devstack sudo[115550]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 1073741824" returned: 0 in 0.840s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.661s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=121,cinder:UPDATE=173,cinder:INSERT=43,cinder:DELETE=18 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:41:16 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Deleted volume successfully. Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-b92c3555-add3-435f-81aa-1cd1c6411e61 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-eb09dc36-0607-4b3c-96e7-02d0ebbd3d91-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:16 devstack sudo[115557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 Jun 24 00:41:16 devstack sudo[115557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-dda7be4a-0477-4d7a-a492-d23fffc0acd2-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-dda7be4a-0477-4d7a-a492-d23fffc0acd2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-quobyte-dda7be4a-0477-4d7a-a492-d23fffc0acd2" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-dda7be4a-0477-4d7a-a492-d23fffc0acd2" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[928ed22a-b844-4d83-8640-162ea2716a69]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-d90481a0-0677-46d8-8917-5289a2bc7d86-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:16 devstack sudo[115559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 Jun 24 00:41:16 devstack sudo[115559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-d90481a0-0677-46d8-8917-5289a2bc7d86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-quobyte-099e21c4-943d-4028-992f-01e121a7f511" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-099e21c4-943d-4028-992f-01e121a7f511" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-quobyte-d90481a0-0677-46d8-8917-5289a2bc7d86" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:16 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-d90481a0-0677-46d8-8917-5289a2bc7d86" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Deleting offline snapshot d90481a0-0677-46d8-8917-5289a2bc7d86 of volume 099e21c4-943d-4028-992f-01e121a7f511 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] snapshot_file for this snap is: volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6351cfb-281c-401b-acae-cd2ab00d7b7d]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:17 devstack sudo[115561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 Jun 24 00:41:17 devstack sudo[115561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:17 devstack sudo[115557]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362" returned: 0 in 0.679s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb10f5ea-aa25-4678-88f1-bd0155a441c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76633bde-7217-4610-b2c3-f87b202fe362', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152eed56-a1d5-4cd4-9109-394f9e6ddf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:17 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Volume volume-76633bde-7217-4610-b2c3-f87b202fe362 (76633bde-7217-4610-b2c3-f87b202fe362): created successfully Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152eed56-a1d5-4cd4-9109-394f9e6ddf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Flow 'volume_create_manager' (f2e9c78c-8682-46c0-9c79-716a7d72e238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:UPDATE=178,cinder:SELECT=132,cinder:DELETE=17,cinder:INSERT=45 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:41:17 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-5739c2a0-50f4-4f67-8052-dfa88cdcaf75 tempest-SnapshotDependencyTests-1120044556 None] Created volume successfully. Jun 24 00:41:17 devstack sudo[115559]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2" returned: 0 in 0.808s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:17 devstack sudo[115567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2 Jun 24 00:41:17 devstack sudo[115567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Creating offline snapshot 07b43645-25d4-41a6-bb31-3b5b7bddfe71 of volume 76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0f79d3-9d7b-42a8-81d0-e5511b7902ef]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:17 devstack sudo[115561]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86" returned: 0 in 0.828s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-099e21c4-943d-4028-992f-01e121a7f511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:41:17 devstack sudo[115572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 Jun 24 00:41:17 devstack sudo[115572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ea96f-b91f-4d9a-95f2-1dc9d2a7b891]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:17 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:18 devstack sudo[115577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 Jun 24 00:41:18 devstack sudo[115577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:18 devstack sudo[115567]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-dda7be4a-0477-4d7a-a492-d23fffc0acd2" returned: 0 in 0.689s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-dda7be4a-0477-4d7a-a492-d23fffc0acd2" released by "delete_volume" :: held 1.542s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created reservations ['7a1ac238-2316-4418-a7ed-7309f3f50ab8', 'd3239328-2e3b-46e9-aa3a-d5ac96fe867b', '049dc2d0-578a-4f98-8b90-c181c2f1d3c8', 'e9fb5976-534b-4c91-b1de-a1191d4d8030'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:18 devstack sudo[115583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:18 devstack sudo[115583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:18 devstack sudo[115572]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362" returned: 0 in 0.808s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:18 devstack sudo[115585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 1G Jun 24 00:41:18 devstack sudo[115585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:18 devstack sudo[115577]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511" returned: 0 in 0.824s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:18 devstack sudo[115590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 Jun 24 00:41:18 devstack sudo[115590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:18 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-5a6c28c6-3976-422f-b454-362b88c9dc06-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-5a6c28c6-3976-422f-b454-362b88c9dc06-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-quobyte-5a6c28c6-3976-422f-b454-362b88c9dc06" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-5a6c28c6-3976-422f-b454-362b88c9dc06" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cce35d4-9bc6-4a2f-860c-ba9352df5d55]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:19 devstack sudo[115583]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.736s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:19 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Deleted volume successfully. Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-31a629dd-310c-49e0-a5c8-5fa447059fc6 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-dda7be4a-0477-4d7a-a492-d23fffc0acd2-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:19 devstack sudo[115593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 Jun 24 00:41:19 devstack sudo[115593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:19 devstack sudo[115590]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86" returned: 0 in 0.784s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:19 devstack sudo[115601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86 Jun 24 00:41:19 devstack sudo[115601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:19 devstack sudo[115585]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 1G" returned: 0 in 1.058s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76633bde-7217-4610-b2c3-f87b202fe362 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:19 devstack sudo[115603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76633bde-7217-4610-b2c3-f87b202fe362 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 Jun 24 00:41:19 devstack sudo[115603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:19 devstack sudo[115593]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06" returned: 0 in 0.834s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:19 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:20 devstack sudo[115608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06 Jun 24 00:41:20 devstack sudo[115608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:20 devstack sudo[115601]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511.d90481a0-0677-46d8-8917-5289a2bc7d86" returned: 0 in 0.720s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-d90481a0-0677-46d8-8917-5289a2bc7d86" released by "_delete_snapshot" :: held 3.286s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-099e21c4-943d-4028-992f-01e121a7f511" released by "delete_snapshot" :: held 3.316s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Created reservations ['c70d6833-44b4-4e07-897b-baa24992f24b', 'ca09ab74-ddae-4ad4-8fb4-12c880b00864', 'c2b87feb-9943-4662-b146-130c4191e740', '39b5e951-45cf-4f12-b9d9-9803bddfc326'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:20 devstack sudo[115603]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76633bde-7217-4610-b2c3-f87b202fe362 -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71" returned: 0 in 0.758s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:20 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 is being set with open permissions: ugo+rw Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:20 devstack sudo[115614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 Jun 24 00:41:20 devstack sudo[115614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:20 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Delete snapshot completed successfully. Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-35b2897a-5d13-4a85-b59f-b2ae1e33bcf3 tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-d90481a0-0677-46d8-8917-5289a2bc7d86-delete_snapshot" released by "delete_snapshot" :: held 3.505s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:20 devstack sudo[115608]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-5a6c28c6-3976-422f-b454-362b88c9dc06" returned: 0 in 0.741s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-5a6c28c6-3976-422f-b454-362b88c9dc06" released by "delete_volume" :: held 1.635s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created reservations ['c20328b1-b91c-47a9-8d77-afbf9069026e', 'd56605d0-080a-4ab1-a3e0-83d7df52357a', '7f800e8e-331a-4ed5-a612-860200b87b92', 'ebe72a0e-6166-49ef-87de-ad49a013f13d'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:20 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:20 devstack sudo[115617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:20 devstack sudo[115617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:21 devstack sudo[115614]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71" returned: 0 in 0.633s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:21 devstack sudo[115620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.info Jun 24 00:41:21 devstack sudo[115620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-099e21c4-943d-4028-992f-01e121a7f511-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-099e21c4-943d-4028-992f-01e121a7f511-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "cinder-quobyte-099e21c4-943d-4028-992f-01e121a7f511" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-099e21c4-943d-4028-992f-01e121a7f511" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf16102-ac84-4b08-9088-b9cce7b8c846]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-18916ad5-bc65-45ab-a755-f21a507e9cf9-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-18916ad5-bc65-45ab-a755-f21a507e9cf9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-quobyte-18916ad5-bc65-45ab-a755-f21a507e9cf9" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:21 devstack sudo[115622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 Jun 24 00:41:21 devstack sudo[115622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-18916ad5-bc65-45ab-a755-f21a507e9cf9" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc16aa35-e222-48ac-9d07-60b451fa0b7f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:21 devstack sudo[115617]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.756s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:21 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Deleted volume successfully. Jun 24 00:41:21 devstack sudo[115625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 Jun 24 00:41:21 devstack sudo[115625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-353af25d-fb52-463d-8a89-1336be53bc84 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-5a6c28c6-3976-422f-b454-362b88c9dc06-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:21 devstack sudo[115620]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.info" returned: 0 in 0.689s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:21 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.info is being set with open permissions: ugo+rw Jun 24 00:41:21 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:21 devstack sudo[115628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.info Jun 24 00:41:21 devstack sudo[115628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:22 devstack sudo[115622]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511" returned: 0 in 0.838s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:22 devstack sudo[115633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511 Jun 24 00:41:22 devstack sudo[115633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:22 devstack sudo[115625]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9" returned: 0 in 0.785s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:22 devstack sudo[115639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9 Jun 24 00:41:22 devstack sudo[115639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:22 devstack sudo[115628]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.info" returned: 0 in 0.688s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.718s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:22 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-11fbeb34-d921-4261-832a-fca8346c7267 tempest-SnapshotDependencyTests-1120044556 None] Create snapshot completed successfully Jun 24 00:41:22 devstack sudo[115633]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-099e21c4-943d-4028-992f-01e121a7f511" returned: 0 in 0.647s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-quobyte-099e21c4-943d-4028-992f-01e121a7f511" released by "delete_volume" :: held 1.541s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Created reservations ['aca9f66e-0bba-4158-a54b-e828a97e209d', '649ec165-0c8a-4d14-877d-2e14aa2984f2', '5d0b2c7c-d784-4b5e-ad34-7b2c43d2e84b', 'ad244fa4-2333-44d2-9038-4d15c75b1f90'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:22 devstack sudo[115639]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-18916ad5-bc65-45ab-a755-f21a507e9cf9" returned: 0 in 0.658s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:22 devstack sudo[115643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:22 devstack sudo[115643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:22 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-18916ad5-bc65-45ab-a755-f21a507e9cf9" released by "delete_volume" :: held 1.499s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created reservations ['2314ed60-9fc6-4dfc-aa1e-10b982f729ba', 'f9eb27ec-858c-4832-b60a-14c6e08e6217', 'f4c52bf3-f61f-4e2b-8571-89f376831bd9', '90bbe67b-172b-445e-9990-9d0a010e388f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:23 devstack sudo[115645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:23 devstack sudo[115645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:23 devstack sudo[115643]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.704s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Deleted volume successfully. Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-b504c07d-313a-48aa-8e49-8559ab8da086-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Flow 'volume_create_manager' (ac237954-9659-4b1d-b30c-c6c675f673b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d5fe95-26ba-46f6-a6cf-b52bd18ec637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-6b509422-6b64-4f9f-bc46-4586d67c7ddf tempest-CreateVolumesFromSnapshotTest-120681477 None] Lock "cinder-099e21c4-943d-4028-992f-01e121a7f511-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-b504c07d-313a-48aa-8e49-8559ab8da086-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d5fe95-26ba-46f6-a6cf-b52bd18ec637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e833b0af-5588-4cb2-8c4b-1fec03026951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c2f1be3cd149fbbe5c6f6de13c0246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07b43645-25d4-41a6-bb31-3b5b7bddfe71,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:24Z,use_quota=True,user_id='1f5e4e832b5748e581e5a8f208105075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d78678-c715-44e1-bdbe-be66850fc8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d78678-c715-44e1-bdbe-be66850fc8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efa99e1-371c-4a01-bb65-54496fe50b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efa99e1-371c-4a01-bb65-54496fe50b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e833b0af-5588-4cb2-8c4b-1fec03026951', 'volume_name': 'volume-e833b0af-5588-4cb2-8c4b-1fec03026951', 'volume_size': 1, 'snapshot_id': '07b43645-25d4-41a6-bb31-3b5b7bddfe71'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b1ffd2-9110-4a88-8904-7b846d654b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b1ffd2-9110-4a88-8904-7b846d654b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e65fdd-2daf-4bcc-a60c-b3bac427b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:23 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Volume e833b0af-5588-4cb2-8c4b-1fec03026951: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e833b0af-5588-4cb2-8c4b-1fec03026951', 'volume_size': 1, 'snapshot_id': '07b43645-25d4-41a6-bb31-3b5b7bddfe71'} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-quobyte-07b43645-25d4-41a6-bb31-3b5b7bddfe71-e833b0af-5588-4cb2-8c4b-1fec03026951" by "_create_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:23 devstack sudo[115645]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-07b43645-25d4-41a6-bb31-3b5b7bddfe71-e833b0af-5588-4cb2-8c4b-1fec03026951" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Creating volume e833b0af-5588-4cb2-8c4b-1fec03026951 from snapshot 07b43645-25d4-41a6-bb31-3b5b7bddfe71 {{(pid=94472) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-quobyte-e833b0af-5588-4cb2-8c4b-1fec03026951" by "_copy_volume_from_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.769s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-quobyte-b504c07d-313a-48aa-8e49-8559ab8da086" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:23 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Deleted volume successfully. Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-e833b0af-5588-4cb2-8c4b-1fec03026951" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] snapshot: 07b43645-25d4-41a6-bb31-3b5b7bddfe71, volume: e833b0af-5588-4cb2-8c4b-1fec03026951, {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-b504c07d-313a-48aa-8e49-8559ab8da086" acquired by "delete_volume" :: waited 0.051s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[97115693-5440-4296-96d7-7acf59f42a66]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-fa8cdee8-1a70-47d0-96fc-8c1963522975 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-18916ad5-bc65-45ab-a755-f21a507e9cf9-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[308b8169-ab54-48ed-95f0-0f0d94a35601]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:23 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:24 devstack sudo[115649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 Jun 24 00:41:24 devstack sudo[115649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:24 devstack sudo[115650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 Jun 24 00:41:24 devstack sudo[115650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:24 devstack sudo[115649]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71" returned: 0 in 0.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76633bde-7217-4610-b2c3-f87b202fe362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 00:41:24 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Creating direct copy from snapshot {{(pid=94472) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 00:41:24 devstack sudo[115650]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086" returned: 0 in 0.832s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:24 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[26070dfd-6ac2-42a9-9620-cbe2ccdad97f]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:24 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:24 devstack sudo[115659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086 Jun 24 00:41:24 devstack sudo[115659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:24 devstack sudo[115661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 Jun 24 00:41:24 devstack sudo[115661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:25 devstack sudo[115659]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b504c07d-313a-48aa-8e49-8559ab8da086" returned: 0 in 0.691s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-b504c07d-313a-48aa-8e49-8559ab8da086" released by "delete_volume" :: held 1.589s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created reservations ['34777815-0de3-48d9-a50f-8b24fe92618b', '8153390e-5e1c-4585-a92f-a38239bc3c85', 'bdd131ba-8740-49bd-81ff-39eb1c452c74', 'a0a792b0-79ad-45f7-9fd2-5b85b57cd382'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:25 devstack sudo[115661]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362" returned: 0 in 0.849s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG cinder.utils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Path /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 not found in is_blk_device check {{(pid=94472) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:25 devstack sudo[115667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:25 devstack sudo[115667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:25 devstack sudo[115668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 Jun 24 00:41:25 devstack sudo[115668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:25 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-cc07017d-a48b-42ef-9f4a-08ab26ec7651-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-cc07017d-a48b-42ef-9f4a-08ab26ec7651-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-quobyte-cc07017d-a48b-42ef-9f4a-08ab26ec7651" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-cc07017d-a48b-42ef-9f4a-08ab26ec7651" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:26 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4b7e6-b93b-44a3-8b86-273d2e568997]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:26 devstack sudo[115671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 Jun 24 00:41:26 devstack sudo[115671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:26 devstack sudo[115667]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:26 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.780s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:26 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:26 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Deleted volume successfully. Jun 24 00:41:26 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-e2b1dfb5-c22d-402b-ae26-06c6c9c4ce4a tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-b504c07d-313a-48aa-8e49-8559ab8da086-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:27 devstack sudo[115671]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651" returned: 0 in 1.800s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:27 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:28 devstack sudo[115689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651 Jun 24 00:41:28 devstack sudo[115689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:29 devstack sudo[115689]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:29 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-cc07017d-a48b-42ef-9f4a-08ab26ec7651" returned: 0 in 1.760s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:29 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-cc07017d-a48b-42ef-9f4a-08ab26ec7651" released by "delete_volume" :: held 3.643s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:29 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created reservations ['cd04f453-906e-4f69-a5ff-5cf7a3195c21', '5bfed175-944a-4890-8f7f-ed97052d1344', '669143b4-ceea-419e-adb4-e4715321ff9b', 'da3da855-4c2f-4fb5-85e9-cc04c88dc33b'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:30 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:30 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:30 devstack sudo[115692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:30 devstack sudo[115692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-b3e95647-1032-425b-9dba-5f2c387e4cca-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:30 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-b3e95647-1032-425b-9dba-5f2c387e4cca-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "cinder-quobyte-b3e95647-1032-425b-9dba-5f2c387e4cca" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-b3e95647-1032-425b-9dba-5f2c387e4cca" acquired by "delete_volume" :: waited 0.029s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab871d6-7d2f-41cc-8eb9-8e7710c4eaa9]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:31 devstack sudo[115694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca Jun 24 00:41:31 devstack sudo[115694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:31 devstack sudo[115668]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951" returned: 0 in 5.759s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[7011ca24-5386-4efc-be04-69eb8a93ea48]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:31 devstack sudo[115692]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 1.433s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:31 devstack sudo[115696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 Jun 24 00:41:31 devstack sudo[115696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:31 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Deleted volume successfully. Jun 24 00:41:31 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-db53cf73-ab53-4bb3-aa71-de47016d2583 tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-cc07017d-a48b-42ef-9f4a-08ab26ec7651-delete_volume" released by "delete_volume" :: held 5.621s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:32 devstack sudo[115694]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Flow 'volume_create_manager' (b47226e2-da7d-436a-bb39-ae3dc101591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98be394-bee1-4ff7-8236-ed8e4e1c642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca" returned: 0 in 1.015s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98be394-bee1-4ff7-8236-ed8e4e1c642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ec5c39-5ec7-42cf-bc10-54f12824ae09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098c9334b7f849f2aaa5ca98baf2051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:32Z,use_quota=True,user_id='29acb042a4024598a1dbe7eceab9ccad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:32 devstack sudo[115702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca Jun 24 00:41:32 devstack sudo[115702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e704f90-4ef7-4cf2-b699-190259e1a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e704f90-4ef7-4cf2-b699-190259e1a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07652b8-b60b-4697-a9a1-80bd36a19e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.image.glance [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Creating Keystone auth plugin from conf {{(pid=94472) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07652b8-b60b-4697-a9a1-80bd36a19e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0ec5c39-5ec7-42cf-bc10-54f12824ae09', 'volume_name': 'volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09', 'volume_size': 1, 'image_id': 'faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ad994effb912a538937eb340e6dcff5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '098c9334b7f849f2aaa5ca98baf2051b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6dc84dc377aa05f4aa8294085e15b62990cb8e10bd15dacc38d1252396825e6290fd32c6de32277bfcb2839f2f55c049a252c9d2f1a069182d38347007b2a982', 'id': 'faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'created_at': datetime.datetime(2026, 6, 23, 22, 41, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 41, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4903fd2f-62be-41ca-bf7a-ebb7c9728bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4903fd2f-62be-41ca-bf7a-ebb7c9728bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8ae925-a065-4fe2-b95f-d957e2204a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:32 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Volume c0ec5c39-5ec7-42cf-bc10-54f12824ae09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09', 'volume_size': 1, 'image_id': 'faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ad994effb912a538937eb340e6dcff5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '098c9334b7f849f2aaa5ca98baf2051b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6dc84dc377aa05f4aa8294085e15b62990cb8e10bd15dacc38d1252396825e6290fd32c6de32277bfcb2839f2f55c049a252c9d2f1a069182d38347007b2a982', 'id': 'faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'created_at': datetime.datetime(2026, 6, 23, 22, 41, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 41, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86/file', 'properties': {}}, 'image_service': } Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Trying to clone c0ec5c39-5ec7-42cf-bc10-54f12824ae09 from image faf58a01-7ce6-4272-9f47-8a3e3b867b86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'metadata': {}}]). {{(pid=94472) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 00:41:32 devstack sudo[115696]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362" returned: 0 in 1.005s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Image conversion details: src /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:41:32 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Converted 1024.00 MB image at 177.76 MB/s Jun 24 00:41:32 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 is being set with open permissions: ugo+rw Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:32 devstack sudo[115707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 Jun 24 00:41:32 devstack sudo[115707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 00:41:32 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Image download 0.00 MB at 0.00 MB/s Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae026cd-dd5d-496c-9abf-fe9bb4bf87aa]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:32 devstack sudo[115709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD Jun 24 00:41:32 devstack sudo[115709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:32 devstack sudo[115702]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-b3e95647-1032-425b-9dba-5f2c387e4cca" returned: 0 in 0.715s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-quobyte-b3e95647-1032-425b-9dba-5f2c387e4cca" released by "delete_volume" :: held 1.817s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:32 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Created reservations ['3994b9d2-72ff-4d47-86f5-a8edff6e5835', 'a72d2b46-8fee-4e80-be70-b1061a513506', '75233d14-b16b-435f-933b-4af0e94c0287', '9accc8d2-4f0b-4538-9bd1-123f57a10a06'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:33 devstack sudo[115712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:33 devstack sudo[115712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:33 devstack sudo[115707]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951" returned: 0 in 0.694s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-e833b0af-5588-4cb2-8c4b-1fec03026951" released by "_copy_volume_from_snapshot" :: held 9.273s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-07b43645-25d4-41a6-bb31-3b5b7bddfe71-e833b0af-5588-4cb2-8c4b-1fec03026951" released by "_create_volume_from_snapshot" :: held 9.321s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.349s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e65fdd-2daf-4bcc-a60c-b3bac427b06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e833b0af-5588-4cb2-8c4b-1fec03026951', 'volume_size': 1, 'snapshot_id': '07b43645-25d4-41a6-bb31-3b5b7bddfe71'}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c20244-4187-47ae-a5df-2947637797a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:33 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Volume volume-e833b0af-5588-4cb2-8c4b-1fec03026951 (e833b0af-5588-4cb2-8c4b-1fec03026951): created successfully Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c20244-4187-47ae-a5df-2947637797a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Flow 'volume_create_manager' (ac237954-9659-4b1d-b30c-c6c675f673b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-82a76ee6-fbcf-466b-9936-e836f1f263a6 tempest-SnapshotDependencyTests-1120044556 None] Created volume successfully. Jun 24 00:41:33 devstack sudo[115709]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD" returned: 0 in 0.817s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:33 devstack sudo[115717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD Jun 24 00:41:33 devstack sudo[115717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-07b43645-25d4-41a6-bb31-3b5b7bddfe71-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-07b43645-25d4-41a6-bb31-3b5b7bddfe71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-quobyte-76633bde-7217-4610-b2c3-f87b202fe362" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-76633bde-7217-4610-b2c3-f87b202fe362" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-quobyte-07b43645-25d4-41a6-bb31-3b5b7bddfe71" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-07b43645-25d4-41a6-bb31-3b5b7bddfe71" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Deleting offline snapshot 07b43645-25d4-41a6-bb31-3b5b7bddfe71 of volume 76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] snapshot_file for this snap is: volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[957f7eeb-db19-48fd-bfe8-c1aaa54a88a6]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:33 devstack sudo[115712]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.803s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:33 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Deleted volume successfully. Jun 24 00:41:33 devstack sudo[115720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 Jun 24 00:41:33 devstack sudo[115720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:33 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-80a8c1dc-672c-4d27-a210-169cf6dc87ec tempest-CreateVolumesFromSourceVolumeTest-1543188589 None] Lock "cinder-b3e95647-1032-425b-9dba-5f2c387e4cca-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:34 devstack sudo[115717]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD" returned: 1 in 0.824s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Temporary image faf58a01-7ce6-4272-9f47-8a3e3b867b86 is fetched for user 29acb042a4024598a1dbe7eceab9ccad. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb0f260-28e1-43f3-bba0-44c850ccac0c]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:34 devstack sudo[115725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD Jun 24 00:41:34 devstack sudo[115725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:34 devstack sudo[115720]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71" returned: 0 in 0.959s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76633bde-7217-4610-b2c3-f87b202fe362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fab069c-faf8-4fe4-b71a-00d4a6da14e9]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:34 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:34 devstack sudo[115730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 Jun 24 00:41:34 devstack sudo[115730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:35 devstack sudo[115725]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:35 devstack sudo[115734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD Jun 24 00:41:35 devstack sudo[115734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:35 devstack sudo[115730]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362" returned: 0 in 0.786s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:35 devstack sudo[115739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 Jun 24 00:41:35 devstack sudo[115739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:35 devstack sudo[115734]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD" returned: 1 in 0.727s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ec5c39-5ec7-42cf-bc10-54f12824ae09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098c9334b7f849f2aaa5ca98baf2051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:32Z,use_quota=True,user_id='29acb042a4024598a1dbe7eceab9ccad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Creating volume c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:35 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:35 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:35 devstack sudo[115744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 1073741824 Jun 24 00:41:35 devstack sudo[115744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:36 devstack sudo[115739]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71" returned: 0 in 0.769s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:36 devstack sudo[115749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71 Jun 24 00:41:36 devstack sudo[115749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:36 devstack sudo[115744]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 1073741824" returned: 0 in 0.803s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:36 devstack sudo[115755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 Jun 24 00:41:36 devstack sudo[115755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:36 devstack sudo[115749]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:36 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362.07b43645-25d4-41a6-bb31-3b5b7bddfe71" returned: 0 in 0.658s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-07b43645-25d4-41a6-bb31-3b5b7bddfe71" released by "_delete_snapshot" :: held 3.311s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-76633bde-7217-4610-b2c3-f87b202fe362" released by "delete_snapshot" :: held 3.337s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Created reservations ['f6d29c87-a551-4a55-9d45-6a895dade684', '19aa9a80-f73a-42a5-bd03-1231049d3e13', 'a76dd833-7a80-4416-84cf-4c48b5ee913e', '7dc9b076-611b-4287-a967-d364d76af615'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:37 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Delete snapshot completed successfully. Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-65a5fe48-c3fd-412a-a58b-1c58cb2afd5b tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-07b43645-25d4-41a6-bb31-3b5b7bddfe71-delete_snapshot" released by "delete_snapshot" :: held 3.490s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:37 devstack sudo[115755]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" returned: 0 in 0.618s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Attempting download of faf58a01-7ce6-4272-9f47-8a3e3b867b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'metadata': {}}])) to volume c0ec5c39-5ec7-42cf-bc10-54f12824ae09. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57dce66-f8f0-41e0-b214-bead2e23fcdb]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_faf58a01-7ce6-4272-9f47-8a3e3b867b86__75t31jj {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:37 devstack sudo[115759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_faf58a01-7ce6-4272-9f47-8a3e3b867b86__75t31jj Jun 24 00:41:37 devstack sudo[115759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-76633bde-7217-4610-b2c3-f87b202fe362-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-76633bde-7217-4610-b2c3-f87b202fe362-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-quobyte-76633bde-7217-4610-b2c3-f87b202fe362" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:37 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-76633bde-7217-4610-b2c3-f87b202fe362" acquired by "delete_volume" :: waited 0.021s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d44be2-89d2-49c8-8612-a66217ab08f3]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:38 devstack sudo[115759]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_faf58a01-7ce6-4272-9f47-8a3e3b867b86__75t31jj" returned: 0 in 0.701s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_faf58a01-7ce6-4272-9f47-8a3e3b867b86__75t31jj {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:38 devstack sudo[115763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 Jun 24 00:41:38 devstack sudo[115763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:38 devstack sudo[115764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_faf58a01-7ce6-4272-9f47-8a3e3b867b86__75t31jj Jun 24 00:41:38 devstack sudo[115764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:38 devstack sudo[115763]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362" returned: 0 in 0.785s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:38 devstack sudo[115772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362 Jun 24 00:41:38 devstack sudo[115772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:38 devstack sudo[115764]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_faf58a01-7ce6-4272-9f47-8a3e3b867b86__75t31jj" returned: 1 in 0.781s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_faf58a01-7ce6-4272-9f47-8a3e3b867b86__75t31jj' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[be28a802-fe8a-47f0-af7c-749c3207c551]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:38 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:38 devstack sudo[115774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD Jun 24 00:41:38 devstack sudo[115774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:39 devstack sudo[115772]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-76633bde-7217-4610-b2c3-f87b202fe362" returned: 0 in 0.659s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-76633bde-7217-4610-b2c3-f87b202fe362" released by "delete_volume" :: held 1.531s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Created reservations ['1329863a-9795-44d2-a822-af6ca01111eb', '4245e16a-97b0-4779-83fb-8fb4a52ba350', 'c4f49b63-c272-4283-aee2-1c9371a62b34', '7b8bc3c8-8f69-47cf-8cdb-8a0803258b15'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:39 devstack sudo[115774]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD" returned: 0 in 0.771s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:39 devstack sudo[115779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:39 devstack sudo[115779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:39 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:39 devstack sudo[115782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:39 devstack sudo[115782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:39 devstack sudo[115780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD Jun 24 00:41:39 devstack sudo[115780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-e833b0af-5588-4cb2-8c4b-1fec03026951-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-e833b0af-5588-4cb2-8c4b-1fec03026951-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "cinder-quobyte-e833b0af-5588-4cb2-8c4b-1fec03026951" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-e833b0af-5588-4cb2-8c4b-1fec03026951" acquired by "delete_volume" :: waited 0.038s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[396949a8-78e2-4046-8972-a7e0dac380b6]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:40 devstack sudo[115779]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.728s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:40 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Deleted volume successfully. Jun 24 00:41:40 devstack sudo[115780]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD" returned: 1 in 0.744s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] faf58a01-7ce6-4272-9f47-8a3e3b867b86 was raw, converting to raw {{(pid=94472) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:40 devstack sudo[115787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 Jun 24 00:41:40 devstack sudo[115787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-2cb2d62f-b302-42bc-9dba-fdb8ec26cee2 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-76633bde-7217-4610-b2c3-f87b202fe362-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:40 devstack sudo[115791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 Jun 24 00:41:40 devstack sudo[115791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:40 devstack sudo[115782]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.736s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG oslo_service.periodic_task [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] Running periodic task VolumeManager._thread_info {{(pid=94472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread count: 28 {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 00:41:40 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-87ae15eb-1b7d-4b1c-85fd-5a2017c74030 None None] thread info: [<_MainThread(MainThread, started 132247868076160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 00:41:41 devstack sudo[115787]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951" returned: 0 in 0.785s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:41 devstack sudo[115800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951 Jun 24 00:41:41 devstack sudo[115800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:41 devstack sudo[115791]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" returned: 0 in 0.775s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_faf58a01-7ce6-4272-9f47-8a3e3b867b86_ndxauh31devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 00:41:41 devstack cinder-volume[94472]: INFO cinder.image.image_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:41 devstack sudo[115802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 1G Jun 24 00:41:41 devstack sudo[115802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:41 devstack sudo[115800]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-e833b0af-5588-4cb2-8c4b-1fec03026951" returned: 0 in 0.631s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-quobyte-e833b0af-5588-4cb2-8c4b-1fec03026951" released by "delete_volume" :: held 1.480s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Created reservations ['4a57f7d3-03ef-4f0b-80e8-fbc181e4d242', 'c32a0f25-8304-4c60-8d62-f68460ccbe8e', '61434f7c-f460-4d77-84b5-3bf9a8ecc8c9', 'b8dfe75e-bc40-49ba-a60c-6c79c7b9ef02'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:41 devstack sudo[115808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:41 devstack sudo[115808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:41 devstack sudo[115802]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 1G" returned: 0 in 0.710s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f23923e-45e2-4825-afbd-fb071337c66d]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:41 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:42 devstack sudo[115810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 Jun 24 00:41:42 devstack sudo[115810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:42 devstack sudo[115808]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.685s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:42 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:42 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Deleted volume successfully. Jun 24 00:41:42 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-39372a9b-f432-4acb-b4c9-adef34209340 tempest-SnapshotDependencyTests-1120044556 None] Lock "cinder-e833b0af-5588-4cb2-8c4b-1fec03026951-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:42 devstack sudo[115810]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" returned: 0 in 0.754s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:42 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:42 devstack sudo[115815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 Jun 24 00:41:42 devstack sudo[115815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:43 devstack sudo[115815]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" returned: 1 in 0.766s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Downloaded image faf58a01-7ce6-4272-9f47-8a3e3b867b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'metadata': {}}])) to volume c0ec5c39-5ec7-42cf-bc10-54f12824ae09 successfully. {{(pid=94472) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.image.image_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Temporary image faf58a01-7ce6-4272-9f47-8a3e3b867b86 for user 29acb042a4024598a1dbe7eceab9ccad is deleted. {{(pid=94472) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.volume_utils [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Marking volume c0ec5c39-5ec7-42cf-bc10-54f12824ae09 as bootable. {{(pid=94472) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Copying metadata from image faf58a01-7ce6-4272-9f47-8a3e3b867b86 to c0ec5c39-5ec7-42cf-bc10-54f12824ae09. {{(pid=94472) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Creating volume glance metadata for volume c0ec5c39-5ec7-42cf-bc10-54f12824ae09 backed by image faf58a01-7ce6-4272-9f47-8a3e3b867b86 with: {'image_id': 'faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7ad994effb912a538937eb340e6dcff5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94472) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8ae925-a065-4fe2-b95f-d957e2204a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09', 'volume_size': 1, 'image_id': 'faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ad994effb912a538937eb340e6dcff5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '098c9334b7f849f2aaa5ca98baf2051b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6dc84dc377aa05f4aa8294085e15b62990cb8e10bd15dacc38d1252396825e6290fd32c6de32277bfcb2839f2f55c049a252c9d2f1a069182d38347007b2a982', 'id': 'faf58a01-7ce6-4272-9f47-8a3e3b867b86', 'created_at': datetime.datetime(2026, 6, 23, 22, 41, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 22, 41, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/faf58a01-7ce6-4272-9f47-8a3e3b867b86/file', 'properties': {}}, 'image_service': }' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76551bd-ca1f-40d2-8df7-4884b1b37a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:43 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Volume volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 (c0ec5c39-5ec7-42cf-bc10-54f12824ae09): created successfully Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76551bd-ca1f-40d2-8df7-4884b1b37a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Flow 'volume_create_manager' (b47226e2-da7d-436a-bb39-ae3dc101591b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:43 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-891c051c-e04b-4b40-8252-f1959ef60cad tempest-VolumeImageDependencyTests-1955658595 None] Created volume successfully. Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Acquiring lock "cinder-c0ec5c39-5ec7-42cf-bc10-54f12824ae09-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Lock "cinder-c0ec5c39-5ec7-42cf-bc10-54f12824ae09-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Acquiring lock "cinder-quobyte-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Lock "cinder-quobyte-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" acquired by "delete_volume" :: waited 0.018s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc82940-1411-4269-80e3-544db4347a1f]: (4, 'raw') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:43 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:44 devstack sudo[115827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 Jun 24 00:41:44 devstack sudo[115827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:44 devstack sudo[115827]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" returned: 0 in 0.841s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:44 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:44 devstack sudo[115832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 Jun 24 00:41:44 devstack sudo[115832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" returned: 1 in 0.844s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09' failed. Not Retrying. {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 00:41:45 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:45 devstack sudo[115832]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:45 devstack sudo[115837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09 Jun 24 00:41:45 devstack sudo[115837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:46 devstack sudo[115837]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" returned: 0 in 0.706s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Lock "cinder-quobyte-c0ec5c39-5ec7-42cf-bc10-54f12824ae09" released by "delete_volume" :: held 2.453s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Created reservations ['bc1cd382-b6ae-4721-8f25-4e214c1ab3f4', '56ae1c6f-325f-4d1d-a483-975003d4f300', 'ed283486-8053-4bf4-92ae-8cc264684207', '505d5910-4b7c-4221-a820-61e19de68dcb'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:46 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:46 devstack sudo[115842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:41:46 devstack sudo[115842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:47 devstack sudo[115842]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:47 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.691s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:47 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:41:47 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Deleted volume successfully. Jun 24 00:41:47 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-721bf2ad-95fa-4271-b2bb-840e4bfca194 tempest-VolumeImageDependencyTests-1955658595 None] Lock "cinder-c0ec5c39-5ec7-42cf-bc10-54f12824ae09-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Flow 'volume_create_manager' (6dd05269-bed0-4bc3-b8f0-56acbf7eec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625cd4a5-246c-40cb-9034-b976409a12fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625cd4a5-246c-40cb-9034-b976409a12fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e8bc1a-6a29-405f-b059-e823386a4e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6437b20b224bbaa1c484eea96239ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:51Z,use_quota=True,user_id='0cf2fd6c890b49898768c14bbc0e9753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e988e591-1306-4b09-87df-b0e90c5413c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e988e591-1306-4b09-87df-b0e90c5413c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aba674b-4b2a-4da4-9a61-0e90af6bf888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aba674b-4b2a-4da4-9a61-0e90af6bf888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e8bc1a-6a29-405f-b059-e823386a4e99', 'volume_name': 'volume-72e8bc1a-6a29-405f-b059-e823386a4e99', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf690435-82b7-4c37-b088-8da04eede4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf690435-82b7-4c37-b088-8da04eede4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ea15c1-4f4f-445d-9779-7e80e1749434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:50 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Volume 72e8bc1a-6a29-405f-b059-e823386a4e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e8bc1a-6a29-405f-b059-e823386a4e99', 'volume_size': 1} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e8bc1a-6a29-405f-b059-e823386a4e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6437b20b224bbaa1c484eea96239ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:51Z,use_quota=True,user_id='0cf2fd6c890b49898768c14bbc0e9753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Creating volume 72e8bc1a-6a29-405f-b059-e823386a4e99 {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:50 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:50 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:50 devstack sudo[115847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 1073741824 Jun 24 00:41:50 devstack sudo[115847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:51 devstack sudo[115847]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 1073741824" returned: 0 in 0.838s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:51 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:51 devstack sudo[115852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 Jun 24 00:41:51 devstack sudo[115852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:52 devstack sudo[115852]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99" returned: 0 in 0.608s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:52 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:52 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ea15c1-4f4f-445d-9779-7e80e1749434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e8bc1a-6a29-405f-b059-e823386a4e99', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1535eec-ff3b-4a46-a4f0-7937756333c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:52 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Volume volume-72e8bc1a-6a29-405f-b059-e823386a4e99 (72e8bc1a-6a29-405f-b059-e823386a4e99): created successfully Jun 24 00:41:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1535eec-ff3b-4a46-a4f0-7937756333c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:52 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Flow 'volume_create_manager' (6dd05269-bed0-4bc3-b8f0-56acbf7eec13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:52 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-ce9a768b-3c14-4523-ae09-8e9e15558a80 tempest-CinderUnicodeTest-1302417121 None] Created volume successfully. Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94472) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Flow 'volume_create_manager' (76e715aa-5894-4a3d-80ed-b09c6ec9c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9771ad3f-f166-4a13-ac19-cc83d209223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9771ad3f-f166-4a13-ac19-cc83d209223f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-104315798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35770316-75ea-4573-be80-94b1b42ae47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6437b20b224bbaa1c484eea96239ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:53Z,use_quota=True,user_id='0cf2fd6c890b49898768c14bbc0e9753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f1263b-a351-44b6-b196-e178cbb8bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f1263b-a351-44b6-b196-e178cbb8bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22dab695-fcf8-4ef0-80ad-71baba7a4c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22dab695-fcf8-4ef0-80ad-71baba7a4c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35770316-75ea-4573-be80-94b1b42ae47c', 'volume_name': 'volume-35770316-75ea-4573-be80-94b1b42ae47c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786bf52d-045c-4bb8-b938-c00dbca94e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786bf52d-045c-4bb8-b938-c00dbca94e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14cce57-8208-4c76-92e4-a8bcb2b41a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:53 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Volume 35770316-75ea-4573-be80-94b1b42ae47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35770316-75ea-4573-be80-94b1b42ae47c', 'volume_size': 1} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T22:41:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-104315798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35770316-75ea-4573-be80-94b1b42ae47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6437b20b224bbaa1c484eea96239ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T22:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T22:41:53Z,use_quota=True,user_id='0cf2fd6c890b49898768c14bbc0e9753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb62f606-b97a-4bb2-84df-0e9be3446ec4),volume_type_id=fb62f606-b97a-4bb2-84df-0e9be3446ec4)}" {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Creating volume 35770316-75ea-4573-be80-94b1b42ae47c {{(pid=94472) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Selected osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 as target Quobyte volume. {{(pid=94472) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 00:41:53 devstack cinder-volume[94472]: INFO cinder.volume.drivers.remotefs [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] casted to osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01 Jun 24 00:41:53 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c 1073741824 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:53 devstack sudo[115855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c 1073741824 Jun 24 00:41:53 devstack sudo[115855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:54 devstack sudo[115855]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c 1073741824" returned: 0 in 0.857s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:54 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:54 devstack sudo[115860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c Jun 24 00:41:54 devstack sudo[115860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:55 devstack sudo[115860]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c" returned: 0 in 0.614s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'} {{(pid=94472) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14cce57-8208-4c76-92e4-a8bcb2b41a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35770316-75ea-4573-be80-94b1b42ae47c', 'volume_size': 1}' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4584755d-c437-426f-ac16-5f88364c2c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 00:41:55 devstack cinder-volume[94472]: INFO cinder.volume.flows.manager.create_volume [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Volume volume-35770316-75ea-4573-be80-94b1b42ae47c (35770316-75ea-4573-be80-94b1b42ae47c): created successfully Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4584755d-c437-426f-ac16-5f88364c2c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94472) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Flow 'volume_create_manager' (76e715aa-5894-4a3d-80ed-b09c6ec9c972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94472) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 00:41:55 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-eb54a4c2-c7fe-4481-add4-2ef5c6b66e7a tempest-CinderUnicodeTest-1302417121 None] Created volume successfully. Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Creating offline snapshot d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 of volume 35770316-75ea-4573-be80-94b1b42ae47c {{(pid=94472) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da9e844-2ecc-4506-be1b-1e85cf269e21]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:55 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:55 devstack sudo[115863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c Jun 24 00:41:55 devstack sudo[115863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:56 devstack sudo[115863]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c" returned: 0 in 0.724s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:56 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 1G {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:56 devstack sudo[115868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 1G Jun 24 00:41:56 devstack sudo[115868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:57 devstack sudo[115868]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 1G" returned: 0 in 0.748s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35770316-75ea-4573-be80-94b1b42ae47c -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:57 devstack sudo[115875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35770316-75ea-4573-be80-94b1b42ae47c -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 Jun 24 00:41:57 devstack sudo[115875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:57 devstack sudo[115875]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35770316-75ea-4573-be80-94b1b42ae47c -F qcow2 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1" returned: 0 in 0.646s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:57 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 is being set with open permissions: ugo+rw Jun 24 00:41:57 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:57 devstack sudo[115880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 Jun 24 00:41:57 devstack sudo[115880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:58 devstack sudo[115880]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1" returned: 0 in 0.599s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:58 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:58 devstack sudo[115883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.info Jun 24 00:41:58 devstack sudo[115883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:59 devstack sudo[115883]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.info" returned: 0 in 0.607s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:59 devstack cinder-volume[94472]: WARNING cinder.volume.drivers.remotefs [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.info is being set with open permissions: ugo+rw Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.info {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:41:59 devstack sudo[115886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.info Jun 24 00:41:59 devstack sudo[115886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:41:59 devstack sudo[115886]: pam_unix(sudo:session): session closed for user root Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.info" returned: 0 in 0.595s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.036s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:41:59 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-6b736ba4-ca25-4321-97b3-ca2d04102ffb tempest-CinderUnicodeTest-1302417121 None] Create snapshot completed successfully Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "cinder-d2743ffd-f9f3-45f2-a58e-efeff0a7afa1-delete_snapshot" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-d2743ffd-f9f3-45f2-a58e-efeff0a7afa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "cinder-quobyte-35770316-75ea-4573-be80-94b1b42ae47c" by "delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-quobyte-35770316-75ea-4573-be80-94b1b42ae47c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "cinder-quobyte-d2743ffd-f9f3-45f2-a58e-efeff0a7afa1" by "_delete_snapshot" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-quobyte-d2743ffd-f9f3-45f2-a58e-efeff0a7afa1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Deleting offline snapshot d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 of volume 35770316-75ea-4573-be80-94b1b42ae47c {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] snapshot_file for this snap is: volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 {{(pid=94472) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6e3637-ad2e-4115-a680-d84f5b6c4e06]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:41:59 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:00 devstack sudo[115889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 Jun 24 00:42:00 devstack sudo[115889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:00 devstack sudo[115889]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1" returned: 0 in 0.732s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:00 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.remotefs [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35770316-75ea-4573-be80-94b1b42ae47c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94472) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 00:42:00 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1971bc-bb95-4ac3-82cb-82b762dee9f5]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:42:00 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:00 devstack sudo[115894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c Jun 24 00:42:00 devstack sudo[115894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:01 devstack sudo[115894]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c" returned: 0 in 0.764s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:01 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:01 devstack sudo[115899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 Jun 24 00:42:01 devstack sudo[115899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:02 devstack sudo[115899]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1" returned: 0 in 0.711s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:02 devstack sudo[115906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1 Jun 24 00:42:02 devstack sudo[115906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:02 devstack sudo[115906]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:02 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c.d2743ffd-f9f3-45f2-a58e-efeff0a7afa1" returned: 0 in 0.604s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-quobyte-d2743ffd-f9f3-45f2-a58e-efeff0a7afa1" released by "_delete_snapshot" :: held 2.905s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:42:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-quobyte-35770316-75ea-4573-be80-94b1b42ae47c" released by "delete_snapshot" :: held 2.926s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:42:02 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Created reservations ['88f4cc1a-d9e3-4779-8c5d-2299c461c1f8', 'eeb80f31-6909-430d-9e97-74bf8ffe7164', '92f482c4-e059-43f6-a743-e2aac19026b3', 'de71cccc-ba28-4d89-bd35-5e2f589b32be'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:42:02 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Delete snapshot completed successfully. Jun 24 00:42:02 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-a6cce39e-6b11-4538-a620-bce106f9d56d tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-d2743ffd-f9f3-45f2-a58e-efeff0a7afa1-delete_snapshot" released by "delete_snapshot" :: held 3.059s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "cinder-35770316-75ea-4573-be80-94b1b42ae47c-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-35770316-75ea-4573-be80-94b1b42ae47c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "cinder-quobyte-35770316-75ea-4573-be80-94b1b42ae47c" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:42:03 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-quobyte-35770316-75ea-4573-be80-94b1b42ae47c" acquired by "delete_volume" :: waited 0.014s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:42:03 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2044c1-077c-410d-a1ed-fc76b55c3a30]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:42:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:03 devstack sudo[115909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c Jun 24 00:42:03 devstack sudo[115909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:03 devstack sudo[115909]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c" returned: 0 in 0.720s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:03 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:03 devstack sudo[115914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c Jun 24 00:42:03 devstack sudo[115914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:04 devstack sudo[115914]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-35770316-75ea-4573-be80-94b1b42ae47c" returned: 0 in 0.685s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-quobyte-35770316-75ea-4573-be80-94b1b42ae47c" released by "delete_volume" :: held 1.462s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Created reservations ['521f092c-cf4a-4045-9c85-132fb92101bb', 'fb6ad256-9b99-4742-adc5-25006f79aad3', 'ed3a9a4d-61ea-4abf-9489-9d85d1b2bcde', '80a3480d-98e5-491c-ab9c-f10daaf58cac'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:42:04 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:04 devstack sudo[115917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:42:04 devstack sudo[115917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "cinder-72e8bc1a-6a29-405f-b059-e823386a4e99-delete_volume" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-72e8bc1a-6a29-405f-b059-e823386a4e99-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "cinder-quobyte-72e8bc1a-6a29-405f-b059-e823386a4e99" by "delete_volume" {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-quobyte-72e8bc1a-6a29-405f-b059-e823386a4e99" acquired by "delete_volume" :: waited 0.013s {{(pid=94472) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b5466e-c945-40b6-b0a0-738ec4355aa7]: (4, 'qcow2') {{(pid=95823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:05 devstack sudo[115917]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.679s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:42:05 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Deleted volume successfully. Jun 24 00:42:05 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-4798cdf7-32bf-4237-8612-ae3388482ce4 tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-35770316-75ea-4573-be80-94b1b42ae47c-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:42:05 devstack sudo[115920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 Jun 24 00:42:05 devstack sudo[115920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:06 devstack sudo[115920]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99" returned: 0 in 0.728s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:06 devstack sudo[115925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99 Jun 24 00:42:06 devstack sudo[115925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:06 devstack sudo[115925]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f/volume-72e8bc1a-6a29-405f-b059-e823386a4e99" returned: 0 in 0.609s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-quobyte-72e8bc1a-6a29-405f-b059-e823386a4e99" released by "delete_volume" :: held 1.378s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG cinder.quota [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Created reservations ['4cc169b0-f572-4fb5-a9a9-1d6dcb9e5b4a', '823b96d8-420d-4ba8-97d5-f1276d95bcd3', '1dfb03d3-3059-4679-a812-cd1e1bb9f00f', '5efbb864-3fe4-459c-9fe0-89aed4ddef4f'] {{(pid=94472) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01': None} {{(pid=94472) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG cinder.volume.drivers.quobyte [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dda5a673-e263-43e3-afed-d204b57fce01'] {{(pid=94472) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.lockutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94472) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 00:42:06 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 00:42:06 devstack sudo[115929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f Jun 24 00:42:06 devstack sudo[115929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 00:42:07 devstack sudo[115929]: pam_unix(sudo:session): session closed for user root Jun 24 00:42:07 devstack cinder-volume[94472]: DEBUG oslo_concurrency.processutils [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6107d1007a201bd075cbe57bff62629f" returned: 0 in 0.629s {{(pid=94472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 00:42:07 devstack cinder-volume[94472]: DEBUG cinder.manager [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Notifying Schedulers of capabilities ... {{(pid=94472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 00:42:07 devstack cinder-volume[94472]: INFO cinder.volume.manager [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Deleted volume successfully. Jun 24 00:42:07 devstack cinder-volume[94472]: DEBUG cinder.coordination [None req-93f0304d-2ab6-4b2c-8d64-b5f2e14d9631 tempest-CinderUnicodeTest-1302417121 None] Lock "cinder-72e8bc1a-6a29-405f-b059-e823386a4e99-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=94472) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 00:42:16 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=98,cinder:UPDATE=137,cinder:DELETE=13,cinder:INSERT=35 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 00:42:17 devstack cinder-volume[94472]: DEBUG dbcounter [-] [94472] Writing DB stats cinder:SELECT=97,cinder:INSERT=39,cinder:UPDATE=121,cinder:DELETE=6 {{(pid=94472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}